Misophonia, a heightened aversion to certain sounds, turns common cognitive and social exercises (e.g., paying attention during a lecture near a pen-clicking classmate, coexisting at the dinner table with a food-chomping relative) into challenging endeavors. How does exposure to triggering sounds impact cognitive and social judgments? We investigated this question in a sample of 65 participants (26 misophonia, 39 control) from the general population. In Phase 1, participants saw faces paired with auditory stimuli while completing a gender judgment task, then reported sound discomfort and identification. In Phase 2, participants saw these same faces with novel ones and reported face likeability and memory. For both oral and non-oral triggers, misophonic participants gave higher discomfort ratings than controls did-especially when identification was correct-and performed slower on the gender judgment. Misophonic participants rated lower likeability than controls did for faces they remembered with high discomfort sounds, and face memory was worse overall for faces originally paired with high discomfort sounds. Altogether, these results suggest that misophonic individuals show impairments on social and cognitive judgments if they must endure discomforting sounds. This experiment helps us better understand the day-to-day impact of misophonia and encourages usage of individualized triggers in future studies.