Tactual display of consonant voicing as a supplement to lipreading. 2005

Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA. hfyuan@mit.edu

This research is concerned with the development and evaluation of a tactual display of consonant voicing to supplement the information available through lipreading for persons with profound hearing impairment. The voicing cue selected is based on the envelope onset asynchrony derived from two different filtered bands (a low-pass band and a high-pass band) of speech. The amplitude envelope of each of the two bands was used to modulate a different carrier frequency which in turn was delivered to one of the two fingers of a tactual stimulating device. Perceptual evaluations of speech reception through this tactual display included the pairwise discrimination of consonants contrasting voicing and identification of a set of 16 consonants under conditions of the tactual cue alone (T), lipreading alone (L), and the combined condition (L + T). The tactual display was highly effective for discriminating voicing at the segmental level and provided a substantial benefit to lipreading on the consonant-identification task. No such benefits of the tactual cue were observed, however, for lipreading of words in sentences due perhaps to difficulties in integrating the tactual and visual cues and to insufficient training on the more difficult task of connected-speech reception.

UI MeSH Term Description Entries
D008085 Lipreading The process by which an observer comprehends speech by watching the movements of the speaker's lips without hearing the speaker's voice. Speechreading,Lip Reading,Lip Readings,Lipreadings,Reading, Lip,Readings, Lip,Speechreadings
D008297 Male Males
D004553 Electric Conductivity The ability of a substrate to allow the passage of ELECTRONS. Electrical Conductivity,Conductivity, Electric,Conductivity, Electrical
D005260 Female Females
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000328 Adult A person having attained full growth or maturity. Adults are of 19 through 44 years of age. For a person between 19 and 24 years of age, YOUNG ADULT is available. Adults
D012682 Sensory Aids Devices and materials used to extend the functioning of the senses, most often including materials adapted for those having visual or hearing impairments and also includes materials that have been translated from one sensory mode to another. (ERIC https://eric.ed.gov/?qt Aid, Sensory,Aids, Sensory,Sensory Aid
D013067 Speech Perception The process whereby an utterance is decoded into a representation in terms of linguistic units (sequences of phonetic segments which combine to form lexical and grammatical morphemes). Speech Discrimination,Discrimination, Speech,Perception, Speech
D014110 Touch Sensation of making physical contact with objects, animate or inanimate. Tactile stimuli are detected by MECHANORECEPTORS in the skin and mucous membranes. Tactile Sense,Sense of Touch,Taction,Sense, Tactile,Senses, Tactile,Tactile Senses,Tactions,Touch Sense,Touch Senses
D015999 Multivariate Analysis A set of techniques used when variation in several variables are studied simultaneously. In statistics, multivariate analysis is interpreted as any analytic method that allows simultaneous study of two or more dependent variables. Analysis, Multivariate,Multivariate Analyses

Related Publications

Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
August 1982, Perception & psychophysics,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
September 1982, Journal of speech and hearing research,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
November 1963, The Journal of speech and hearing disorders,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
January 1984, The Journal of the Acoustical Society of America,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
June 2021, The Journal of the Acoustical Society of America,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
September 1972, Journal of speech and hearing research,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
July 2013, The Journal of the Acoustical Society of America,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
April 1982, The Journal of the Acoustical Society of America,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
September 1990, The Journal of the Acoustical Society of America,
Hanfeng Yuan, and Charlotte M Reed, and Nathaniel I Durlach
August 1988, The Journal of the Acoustical Society of America,
Copied contents to your clipboard!