Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels. 2023

Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK. M.D.Fletcher@soton.ac.uk.

Cochlear implants (CIs) have revolutionised treatment of hearing loss, but large populations globally cannot access them either because of disorders that prevent implantation or because they are expensive and require specialist surgery. Recent technology developments mean that haptic aids, which transmit speech through vibration, could offer a viable low-cost, non-invasive alternative. One important development is that compact haptic actuators can now deliver intense stimulation across multiple frequencies. We explored whether these multiple frequency channels can transfer spectral information to improve tactile phoneme discrimination. To convert audio to vibration, the speech amplitude envelope was extracted from one or more audio frequency bands and used to amplitude modulate one or more vibro-tactile tones delivered to a single-site on the wrist. In 26 participants with normal touch sensitivity, tactile-only phoneme discrimination was assessed with one, four, or eight frequency bands. Compared to one frequency band, performance improved by 5.9% with four frequency bands and by 8.4% with eight frequency bands. The multi-band signal-processing approach can be implemented in real-time on a compact device, and the vibro-tactile tones can be reproduced by the latest compact, low-powered actuators. This approach could therefore readily be implemented in a low-cost haptic hearing aid to deliver real-world benefits.

UI MeSH Term Description Entries
D009536 Niacinamide An important compound functioning as a component of the coenzyme NAD. Its primary significance is in the prevention and/or cure of blacktongue and PELLAGRA. Most animals cannot manufacture this compound in amounts sufficient to prevent nutritional deficiency and it therefore must be supplemented through dietary intake. Nicotinamide,Vitamin B 3,Vitamin PP,3-Pyridinecarboxamide,Enduramide,Nicobion,Nicotinsäureamid Jenapharm,Papulex,Vitamin B3,3 Pyridinecarboxamide,B 3, Vitamin,B3, Vitamin,Jenapharm, Nicotinsäureamid
D002110 Caffeine A methylxanthine naturally occurring in some beverages and also used as a pharmacological agent. Caffeine's most notable pharmacological effect is as a central nervous system stimulant, increasing alertness and producing agitation. It also relaxes SMOOTH MUSCLE, stimulates CARDIAC MUSCLE, stimulates DIURESIS, and appears to be useful in the treatment of some types of headache. Several cellular actions of caffeine have been observed, but it is not entirely clear how each contributes to its pharmacological profile. Among the most important are inhibition of cyclic nucleotide PHOSPHODIESTERASES, antagonism of ADENOSINE RECEPTORS, and modulation of intracellular calcium handling. 1,3,7-Trimethylxanthine,Caffedrine,Coffeinum N,Coffeinum Purrum,Dexitac,Durvitan,No Doz,Percoffedrinol N,Percutaféine,Quick-Pep,Vivarin,Quick Pep,QuickPep
D003638 Deafness A general term for the complete loss of the ability to hear from both ears. Deafness Permanent,Hearing Loss Permanent,Prelingual Deafness,Deaf Mutism,Deaf-Mutism,Deafness, Acquired,Hearing Loss, Complete,Hearing Loss, Extreme,Acquired Deafness,Complete Hearing Loss,Deafness, Prelingual,Extreme Hearing Loss,Permanent, Deafness,Permanent, Hearing Loss,Permanents, Deafness
D006309 Hearing The ability or act of sensing and transducing ACOUSTIC STIMULATION to the CENTRAL NERVOUS SYSTEM. It is also called audition. Audition
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D013067 Speech Perception The process whereby an utterance is decoded into a representation in terms of linguistic units (sequences of phonetic segments which combine to form lexical and grammatical morphemes). Speech Discrimination,Discrimination, Speech,Perception, Speech
D014110 Touch Sensation of making physical contact with objects, animate or inanimate. Tactile stimuli are detected by MECHANORECEPTORS in the skin and mucous membranes. Tactile Sense,Sense of Touch,Taction,Sense, Tactile,Senses, Tactile,Tactile Senses,Tactions,Touch Sense,Touch Senses
D034381 Hearing Loss A general term for the complete or partial loss of the ability to hear from one or both ears. Deafness, Transitory,Hearing Impairment,Hearing Loss, Transitory,Hypoacusis,Transitory Hearing Loss,Deafnesses, Transitory,Hypoacuses,Loss, Hearing,Loss, Transitory Hearing,Transitory Deafness,Transitory Deafnesses,Transitory Hearing Losses

Related Publications

Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
July 1980, The Journal of auditory research,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
January 2015, PloS one,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
January 2024, PloS one,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
February 2022, Scientific reports,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
February 1985, The Journal of the Acoustical Society of America,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
January 2015, PloS one,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
January 1997, Audiology : official organ of the International Society of Audiology,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
June 1990, Journal of speech and hearing research,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
April 2013, Journal of the American Academy of Audiology,
Mark D Fletcher, and Carl A Verschuur, and Samuel W Perry
June 1999, American journal of audiology,
Copied contents to your clipboard!