The tendency to interpret nonverbal social signals as hostile in intention is associated with aggressive responding, poor social functioning and mental illness, and can already be observed in childhood. To investigate the neural correlates of such hostile attributions of social intention, we performed a functional magnetic imaging study in 10-18 year old children and adolescents. Fifty healthy participants rated videos of laughter, which they were told to imagine as being directed towards them, as friendly versus hostile in social intention. Hostile intention ratings were associated with neural response in the right temporal voice area (TVA). Moreover, self-reported trait physical aggression modulated this relationship in both the right TVA and bilateral lingual gyrus, with stronger associations between hostile intention ratings and neural activation in children with higher trait physical aggression scores. Functional connectivity results showed decreased connectivity between the right TVA and left dorsolateral prefrontal cortex with increasing trait physical aggression for making hostile social intention attributions. We conclude that children's social intention attributions are more strongly related to activation of early face and voice-processing regions with increasing trait physical aggression.