Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study. 2012

Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
Medical System Engineering Department, Chiba University, Chiba, Japan. jose.gonzalez@chiba-u.jp

BACKGROUND Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user's mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. METHODS 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject's EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. RESULTS The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. CONCLUSIONS The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual "pop-out" or enhance effect. Also, the NASA TLX, the EEG's Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications.

UI MeSH Term Description Entries
D008297 Male Males
D008606 Mental Processes Conceptual functions or thinking in all its forms. Information Processing, Human,Human Information Processing
D011474 Prosthesis Design The plan and delineation of prostheses in general or a specific prosthesis. Design, Prosthesis,Designs, Prosthesis,Prosthesis Designs
D011597 Psychomotor Performance The coordination of a sensory or ideational (cognitive) process and a motor activity. Perceptual Motor Performance,Sensory Motor Performance,Visual Motor Coordination,Coordination, Visual Motor,Coordinations, Visual Motor,Motor Coordination, Visual,Motor Coordinations, Visual,Motor Performance, Perceptual,Motor Performance, Sensory,Motor Performances, Perceptual,Motor Performances, Sensory,Perceptual Motor Performances,Performance, Perceptual Motor,Performance, Psychomotor,Performance, Sensory Motor,Performances, Perceptual Motor,Performances, Psychomotor,Performances, Sensory Motor,Psychomotor Performances,Sensory Motor Performances,Visual Motor Coordinations
D011603 Psychophysiology The study of the physiological basis of human and animal behavior. Mind-Body Relations (Physiology),Psychology, Physiological,Mind-Body Relationship (Physiology),Physiologic Psychology,Physiological Psychology,Psychology, Physiologic,Mind Body Relations (Physiology),Mind Body Relationship (Physiology),Mind-Body Relation (Physiology),Mind-Body Relationships (Physiology),Physiologic Psychologies,Psychologies, Physiologic,Relation, Mind-Body (Physiology),Relations, Mind-Body (Physiology),Relationship, Mind-Body (Physiology),Relationships, Mind-Body (Physiology)
D011795 Surveys and Questionnaires Collections of data obtained from voluntary subjects. The information usually takes the form of answers to questions, or suggestions. Community Survey,Nonrespondent,Questionnaire,Questionnaires,Respondent,Survey,Survey Method,Survey Methods,Surveys,Baseline Survey,Community Surveys,Methodology, Survey,Nonrespondents,Questionnaire Design,Randomized Response Technique,Repeated Rounds of Survey,Respondents,Survey Methodology,Baseline Surveys,Design, Questionnaire,Designs, Questionnaire,Methods, Survey,Questionnaire Designs,Questionnaires and Surveys,Randomized Response Techniques,Response Technique, Randomized,Response Techniques, Randomized,Survey, Baseline,Survey, Community,Surveys, Baseline,Surveys, Community,Techniques, Randomized Response
D003071 Cognition Intellectual or mental process whereby an organism obtains knowledge. Cognitive Function,Cognitions,Cognitive Functions,Function, Cognitive,Functions, Cognitive
D004562 Electrocardiography Recording of the moment-to-moment electromotive forces of the HEART as projected onto various sites on the body's surface, delineated as a scalar function of time. The recording is monitored by a tracing on slow moving chart paper or by observing it on a cardioscope, which is a CATHODE RAY TUBE DISPLAY. 12-Lead ECG,12-Lead EKG,12-Lead Electrocardiography,Cardiography,ECG,EKG,Electrocardiogram,Electrocardiograph,12 Lead ECG,12 Lead EKG,12 Lead Electrocardiography,12-Lead ECGs,12-Lead EKGs,12-Lead Electrocardiographies,Cardiographies,ECG, 12-Lead,EKG, 12-Lead,Electrocardiograms,Electrocardiographies, 12-Lead,Electrocardiographs,Electrocardiography, 12-Lead
D004569 Electroencephalography Recording of electric currents developed in the brain by means of electrodes applied to the scalp, to the surface of the brain, or placed within the substance of the brain. EEG,Electroencephalogram,Electroencephalograms
D005240 Feasibility Studies Studies to determine the advantages or disadvantages, practicability, or capability of accomplishing a projected plan, study, or project. Feasibility Study,Studies, Feasibility,Study, Feasibility

Related Publications

Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
January 2012, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
January 2015, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
July 2012, Journal of rehabilitation medicine,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
July 2008, The International journal of neuroscience,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
January 2024, Frontiers in neuroscience,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
September 2010, Biomedical engineering online,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
January 2022, IEEE robotics and automation letters,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
January 2020, Frontiers in neuroscience,
Jose Gonzalez, and Hirokazu Soma, and Masashi Sekine, and Wenwei Yu
February 2010, Scandinavian journal of plastic and reconstructive surgery and hand surgery,
Copied contents to your clipboard!