Head movements encode emotions during speech and song. 2016

Steven R Livingstone, and Caroline Palmer
Department of Psychology, McGill University.

When speaking or singing, vocalists often move their heads in an expressive fashion, yet the influence of emotion on vocalists' head motion is unknown. Using a comparative speech/song task, we examined whether vocalists' intended emotions influence head movements and whether those movements influence the perceived emotion. In Experiment 1, vocalists were recorded with motion capture while speaking and singing each statement with different emotional intentions (very happy, happy, neutral, sad, very sad). Functional data analyses showed that head movements differed in translational and rotational displacement across emotional intentions, yet were similar across speech and song, transcending differences in F0 (varied freely in speech, fixed in song) and lexical variability. Head motion specific to emotional state occurred before and after vocalizations, as well as during sound production, confirming that some aspects of movement were not simply a by-product of sound production. In Experiment 2, observers accurately identified vocalists' intended emotion on the basis of silent, face-occluded videos of head movements during speech and song. These results provide the first evidence that head movements encode a vocalist's emotional intent and that observers decode emotional information from these movements. We discuss implications for models of head motion during vocalizations and applied outcomes in social robotics and automated emotion recognition.

UI MeSH Term Description Entries
D008297 Male Males
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D005145 Face The anterior portion of the head that includes the skin, muscles, and structures of the forehead, eyes, nose, mouth, cheeks, and jaw. Faces
D005260 Female Females
D006240 Happiness Highly pleasant emotion characterized by outward manifestations of gratification. Gladness,Joy,Happinesses
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000067289 Behavior Observation Techniques A wide range of formal and informal techniques used to document behavior. Behavior Observation,Behavioral Observation,Behavioral Observation Techniques,Behavior Observation Technique,Behavior Observations,Behavioral Observation Technique,Behavioral Observations,Observation Technique, Behavior,Observation Technique, Behavioral,Observation Techniques, Behavior,Observation Techniques, Behavioral,Observation, Behavior,Observation, Behavioral,Observations, Behavior,Observations, Behavioral
D013060 Speech Communication through a system of conventional vocal symbols. Public Speaking,Speaking, Public
D055815 Young Adult A person between 19 and 24 years of age. Adult, Young,Adults, Young,Young Adults
D019416 Head Movements Voluntary or involuntary motion of head that may be relative to or independent of body; includes animals and humans. Head Movement,Movement, Head,Movements, Head

Related Publications

Steven R Livingstone, and Caroline Palmer
October 2001, Annals of the New York Academy of Sciences,
Steven R Livingstone, and Caroline Palmer
February 2013, Therapeutic advances in psychopharmacology,
Steven R Livingstone, and Caroline Palmer
January 1972, Zhurnal ushnykh, nosovykh i gorlovykh boleznei = The journal of otology, rhinology, and laryngologie [sic],
Steven R Livingstone, and Caroline Palmer
January 1984, Language and speech,
Steven R Livingstone, and Caroline Palmer
July 2017, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Steven R Livingstone, and Caroline Palmer
February 2017, The Journal of the Acoustical Society of America,
Steven R Livingstone, and Caroline Palmer
April 1973, The Cleft palate journal,
Steven R Livingstone, and Caroline Palmer
September 1988, Journal of speech and hearing research,
Steven R Livingstone, and Caroline Palmer
October 1990, Cranio : the journal of craniomandibular practice,
Steven R Livingstone, and Caroline Palmer
January 2014, Interaction studies,
Copied contents to your clipboard!