Combined Auditory and Vibrotactile Feedback for Human-Machine-Interface Control. 2014

Elias B Thorp, and Eric Larson, and Cara E Stepp

The purpose of this study was to determine the effect of the addition of binary vibrotactile stimulation to continuous auditory feedback (vowel synthesis) for human-machine interface (HMI) control. Sixteen healthy participants controlled facial surface electromyography to achieve 2-D targets (vowels). Eight participants used only real-time auditory feedback to locate targets whereas the other eight participants were additionally alerted to having achieved targets with confirmatory vibrotactile stimulation at the index finger. All participants trained using their assigned feedback modality (auditory alone or combined auditory and vibrotactile) over three sessions on three days and completed a fourth session on the third day using novel targets to assess generalization. Analyses of variance performed on the 1) percentage of targets reached and 2) percentage of trial time at the target revealed a main effect for feedback modality: participants using combined auditory and vibrotactile feedback performed significantly better than those using auditory feedback alone. No effect was found for session or the interaction of feedback modality and session, indicating a successful generalization to novel targets but lack of improvement over training sessions. Future research is necessary to determine the cognitive cost associated with combined auditory and vibrotactile feedback during HMI control.

UI MeSH Term Description Entries
D008297 Male Males
D008328 Man-Machine Systems A system in which the functions of the man and the machine are interrelated and necessary for the operation of the system. Man Machine Systems,Man-Machine System,System, Man-Machine,Systems, Man-Machine
D012016 Reference Values The range or frequency distribution of a measurement in a population (of organisms, organs or things) that has not been selected for the presence of disease or abnormality. Normal Range,Normal Values,Reference Ranges,Normal Ranges,Normal Value,Range, Normal,Range, Reference,Ranges, Normal,Ranges, Reference,Reference Range,Reference Value,Value, Normal,Value, Reference,Values, Normal,Values, Reference
D004576 Electromyography Recording of the changes in electric potential of muscle by means of surface or needle electrodes. Electromyogram,Surface Electromyography,Electromyograms,Electromyographies,Electromyographies, Surface,Electromyography, Surface,Surface Electromyographies
D005152 Facial Muscles Muscles of facial expression or mimetic muscles that include the numerous muscles supplied by the facial nerve that are attached to and move the skin of the face. (From Stedman, 25th ed) Mimetic Muscles,Facial Muscle,Mimetic Muscle,Muscle, Facial,Muscle, Mimetic,Muscles, Facial,Muscles, Mimetic
D005260 Female Females
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D001307 Auditory Perception The process whereby auditory stimuli are selected, organized, and interpreted by the organism. Auditory Processing,Perception, Auditory,Processing, Auditory
D001676 Biofeedback, Psychology The therapy technique of providing the status of one's own AUTONOMIC NERVOUS SYSTEM function (e.g., skin temperature, heartbeats, brain waves) as visual or auditory feedback in order to self-control related conditions (e.g., hypertension, migraine headaches). Biofeedback (Psychology),Bogus Physiological Feedback,False Physiological Feedback,Feedback, Psychophysiologic,Biofeedback,Feedback, Psychophysiological,Myofeedback,Psychophysiologic Feedback,Biofeedbacks,Biofeedbacks (Psychology),Biofeedbacks, Psychology,Bogus Physiological Feedbacks,False Physiological Feedbacks,Feedback, Bogus Physiological,Feedback, False Physiological,Feedbacks, Bogus Physiological,Feedbacks, False Physiological,Myofeedbacks,Physiological Feedback, Bogus,Physiological Feedback, False,Physiological Feedbacks, Bogus,Physiological Feedbacks, False,Psychology Biofeedback,Psychology Biofeedbacks
D013647 Task Performance and Analysis The detailed examination of observable activity or behavior associated with the execution or completion of a required function or unit of work. Critical Incident Technique,Critical Incident Technic,Task Performance,Task Performance, Analysis,Critical Incident Technics,Critical Incident Techniques,Incident Technic, Critical,Incident Technics, Critical,Incident Technique, Critical,Incident Techniques, Critical,Performance, Analysis Task,Performance, Task,Performances, Analysis Task,Performances, Task,Task Performances,Task Performances, Analysis,Technic, Critical Incident,Technics, Critical Incident,Technique, Critical Incident,Techniques, Critical Incident

Related Publications

Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2007, Computational intelligence and neuroscience,
Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2022, IEEE transactions on haptics,
Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2014, IEEE transactions on haptics,
Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2021, Sensors (Basel, Switzerland),
Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2012, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Elias B Thorp, and Eric Larson, and Cara E Stepp
September 2018, IEEE transactions on bio-medical engineering,
Elias B Thorp, and Eric Larson, and Cara E Stepp
December 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience,
Elias B Thorp, and Eric Larson, and Cara E Stepp
January 2010, Journal of vestibular research : equilibrium & orientation,
Elias B Thorp, and Eric Larson, and Cara E Stepp
July 2020, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Copied contents to your clipboard!