Communicative constraints affect oro-facial gestures and acoustics: Whispered vs normal speech. 2023

Marzena Żygis, and Susanne Fuchs
Leibniz-Zentrum Allgemeine Sprachwissenschaft, 10117 Berlin, Germany.

The present paper investigates a relationship between the acoustic signal and oro-facial expressions (gestures) when speakers (i) speak normally or whisper, (ii) do or do not see each other, and (iii) produce questions as opposed to statements. To this end, we conducted a motion capture experiment with 17 native speakers of German. The results provide partial support to the hypothesis that the most intensified oro-facial expressions occur when speakers whisper, do not see each other, and produce questions. The results are interpreted in terms of two hypotheses, i.e., the "hand-in-hand" and "trade-off" hypotheses. The relationship between acoustic properties and gestures does not provide straightforward support for one or the other hypothesis. Depending on the condition, speakers used more pronounced gestures and longer duration compensating for the lack of the fundamental frequency (supporting the trade-off hypothesis), but since the gestures were also enhanced when the listener was invisible, we conclude that they are not produced solely for the needs of the listener (supporting the hand-in-hand hypothesis), but rather they seem to help the speaker to achieve an overarching communicative goal.

UI MeSH Term Description Entries
D007802 Language A verbal or nonverbal means of communicating ideas or feelings. Dialect,Dialects,Languages
D005868 Gestures Movement of a part of the body for the purpose of communication. Gesture
D000162 Acoustics The branch of physics that deals with sound and sound waves. In medicine it is often applied in procedures in speech and hearing studies. With regard to the environment, it refers to the characteristics of a room, auditorium, theatre, building, etc. that determines the audibility or fidelity of sounds in it. (From Random House Unabridged Dictionary, 2d ed) Acoustic
D013060 Speech Communication through a system of conventional vocal symbols. Public Speaking,Speaking, Public
D013061 Speech Acoustics The acoustic aspects of speech in terms of frequency, intensity, and time. Acoustics, Speech,Acoustic, Speech,Speech Acoustic
D013067 Speech Perception The process whereby an utterance is decoded into a representation in terms of linguistic units (sequences of phonetic segments which combine to form lexical and grammatical morphemes). Speech Discrimination,Discrimination, Speech,Perception, Speech

Related Publications

Marzena Żygis, and Susanne Fuchs
July 2022, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Marzena Żygis, and Susanne Fuchs
August 2015, Age (Dordrecht, Netherlands),
Marzena Żygis, and Susanne Fuchs
June 1996, Scandinavian journal of psychology,
Marzena Żygis, and Susanne Fuchs
June 1980, Journal of speech and hearing research,
Marzena Żygis, and Susanne Fuchs
December 2015, The Journal of the Acoustical Society of America,
Marzena Żygis, and Susanne Fuchs
February 2022, Journal of speech, language, and hearing research : JSLHR,
Marzena Żygis, and Susanne Fuchs
January 1975, Proceedings of the British Paedodontic Society,
Marzena Żygis, and Susanne Fuchs
August 2018, JAMA otolaryngology-- head & neck surgery,
Copied contents to your clipboard!