GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses. 2017

Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
Institute of Neurorehabilitation Systems, Clinics for Trauma, Orthopedic and Plastic Surgery, University Medical Center Göttingen, Georg-August University, 37075 Göttingen, Germany.

Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on augmented reality. We have developed the GLIMPSE, a Google Glass application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed us to vary the difficulty of the task. The outcome measures were the number of unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback. There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-color clothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task. Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies to accomplish the task. The present study demonstrates a novel self-contained, ready-to-deploy, wearable feedback interface. The interface was successfully tested and was proven to be feasible and functionally beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.

UI MeSH Term Description Entries
D008297 Male Males
D004576 Electromyography Recording of the changes in electric potential of muscle by means of surface or needle electrodes. Electromyogram,Surface Electromyography,Electromyograms,Electromyographies,Electromyographies, Surface,Electromyography, Surface,Surface Electromyographies
D004867 Equipment Design Methods and patterns of fabricating machines and related hardware. Design, Equipment,Device Design,Medical Device Design,Design, Medical Device,Designs, Medical Device,Device Design, Medical,Device Designs, Medical,Medical Device Designs,Design, Device,Designs, Device,Designs, Equipment,Device Designs,Equipment Designs
D005260 Female Females
D006225 Hand The distal part of the arm beyond the wrist in humans and primates, that includes the palm, fingers, and thumb. Hands
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000076142 Virtual Reality Using computer technology to create and maintain an environment and project a user's physical presence in that environment allowing the user to interact with it. Virtual Reality, Educational,Virtual Reality, Instructional,Educational Virtual Realities,Educational Virtual Reality,Instructional Virtual Realities,Instructional Virtual Reality,Realities, Instructional Virtual,Reality, Educational Virtual,Reality, Instructional Virtual,Reality, Virtual,Virtual Realities, Educational,Virtual Realities, Instructional
D000328 Adult A person having attained full growth or maturity. Adults are of 19 through 44 years of age. For a person between 19 and 24 years of age, YOUNG ADULT is available. Adults
D001186 Artificial Limbs Prosthetic replacements for arms, legs, and parts thereof. Arm Prosthesis,Arm, Artificial,Artificial Arm,Artificial Leg,Extremities, Artificial,Leg Prosthesis,Leg, Artificial,Limb Prosthesis,Limbs, Artificial,Arm Prostheses,Arms, Artificial,Artificial Arms,Artificial Extremities,Artificial Extremity,Artificial Legs,Artificial Limb,Extremity, Artificial,Leg Prostheses,Legs, Artificial,Limb Prostheses,Limb, Artificial,Prostheses, Arm,Prostheses, Leg,Prostheses, Limb,Prosthesis, Arm,Prosthesis, Leg,Prosthesis, Limb
D001676 Biofeedback, Psychology The therapy technique of providing the status of one's own AUTONOMIC NERVOUS SYSTEM function (e.g., skin temperature, heartbeats, brain waves) as visual or auditory feedback in order to self-control related conditions (e.g., hypertension, migraine headaches). Biofeedback (Psychology),Bogus Physiological Feedback,False Physiological Feedback,Feedback, Psychophysiologic,Biofeedback,Feedback, Psychophysiological,Myofeedback,Psychophysiologic Feedback,Biofeedbacks,Biofeedbacks (Psychology),Biofeedbacks, Psychology,Bogus Physiological Feedbacks,False Physiological Feedbacks,Feedback, Bogus Physiological,Feedback, False Physiological,Feedbacks, Bogus Physiological,Feedbacks, False Physiological,Myofeedbacks,Physiological Feedback, Bogus,Physiological Feedback, False,Physiological Feedbacks, Bogus,Physiological Feedbacks, False,Psychology Biofeedback,Psychology Biofeedbacks

Related Publications

Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
July 1990, Clinical orthopaedics and related research,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
December 1979, Prosthetics and orthotics international,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
July 2017, IEEE ... International Conference on Rehabilitation Robotics : [proceedings],
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
August 2012, IEEE transactions on bio-medical engineering,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
January 1976, Bulletin of prosthetics research,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
February 2014, Science translational medicine,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
August 2009, International orthopaedics,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
January 2020, Frontiers in neuroscience,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
February 2010, Scandinavian journal of plastic and reconstructive surgery and hand surgery,
Marko Markovic, and Hemanth Karnal, and Bernhard Graimann, and Dario Farina, and Strahinja Dosen
January 2014, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society,
Copied contents to your clipboard!