Few studies have investigated the associations between community crime rates and affective well-being, and how that relationship may differ according to gender. Using data from the National Study of Daily Experiences and the Uniform Crime Reporting Program, the current study examined gender differences between daily affective experiences, crime rates, and perceptions of neighborhood safety. Although feeling unsafe in one's neighborhood was related to worse affective well-being (i.e., higher negative affect/lower positive affect) and larger affective responses to daily stressors, crime rates were not. Women's negative affect was more strongly tied to daily stressors, whereas men's was more strongly tied to lower perceived neighborhood safety. Findings reveal the importance of understanding factors, such as gender, that impact safety concerns beyond that from crime. They also suggest that increasing visibility within communities might dissuade perpetrators and enhance residents' feelings of safety.