Incorporating feedback from multiple sensory modalities enhances brain-machine interface control. 2010

Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
Department of Organismal Biology and Anatomy, University of Chicago, Chicago, Illinois 60637, USA.

The brain typically uses a rich supply of feedback from multiple sensory modalities to control movement in healthy individuals. In many individuals, these afferent pathways, as well as their efferent counterparts, are compromised by disease or injury resulting in significant impairments and reduced quality of life. Brain-machine interfaces (BMIs) offer the promise of recovered functionality to these individuals by allowing them to control a device using their thoughts. Most current BMI implementations use visual feedback for closed-loop control; however, it has been suggested that the inclusion of additional feedback modalities may lead to improvements in control. We demonstrate for the first time that kinesthetic feedback can be used together with vision to significantly improve control of a cursor driven by neural activity of the primary motor cortex (MI). Using an exoskeletal robot, the monkey's arm was moved to passively follow a cortically controlled visual cursor, thereby providing the monkey with kinesthetic information about the motion of the cursor. When visual and proprioceptive feedback were congruent, both the time to successfully reach a target decreased and the cursor paths became straighter, compared with incongruent feedback conditions. This enhanced performance was accompanied by a significant increase in the amount of movement-related information contained in the spiking activity of neurons in MI. These findings suggest that BMI control can be significantly improved in paralyzed patients with residual kinesthetic sense and provide the groundwork for augmenting cortically controlled BMIs with multiple forms of natural or surrogate sensory feedback.

UI MeSH Term Description Entries
D007699 Kinesthesis Sense of movement of a part of the body, such as movement of fingers, elbows, knees, limbs, or weights. Kinesthesia,Kinesthetic Sense,Movement Sensation,Kinestheses,Kinesthesias,Kinesthetic Senses,Movement Sensations
D008253 Macaca mulatta A species of the genus MACACA inhabiting India, China, and other parts of Asia. The species is used extensively in biomedical research and adapts very well to living with humans. Chinese Rhesus Macaques,Macaca mulatta lasiota,Monkey, Rhesus,Rhesus Monkey,Rhesus Macaque,Chinese Rhesus Macaque,Macaca mulatta lasiotas,Macaque, Rhesus,Rhesus Macaque, Chinese,Rhesus Macaques,Rhesus Macaques, Chinese,Rhesus Monkeys
D008297 Male Males
D009044 Motor Cortex Area of the FRONTAL LOBE concerned with primary motor control located in the dorsal PRECENTRAL GYRUS immediately anterior to the central sulcus. It is comprised of three areas: the primary motor cortex located on the anterior paracentral lobule on the medial surface of the brain; the premotor cortex located anterior to the primary motor cortex; and the supplementary motor area located on the midline surface of the hemisphere anterior to the primary motor cortex. Brodmann Area 4,Brodmann Area 6,Brodmann's Area 4,Brodmann's Area 6,Premotor Cortex and Supplementary Motor Cortex,Premotor and Supplementary Motor Cortices,Anterior Central Gyrus,Gyrus Precentralis,Motor Area,Motor Strip,Precentral Gyrus,Precentral Motor Area,Precentral Motor Cortex,Premotor Area,Premotor Cortex,Primary Motor Area,Primary Motor Cortex,Secondary Motor Areas,Secondary Motor Cortex,Somatic Motor Areas,Somatomotor Areas,Supplementary Motor Area,Area 4, Brodmann,Area 4, Brodmann's,Area 6, Brodmann,Area 6, Brodmann's,Area, Motor,Area, Precentral Motor,Area, Premotor,Area, Primary Motor,Area, Secondary Motor,Area, Somatic Motor,Area, Somatomotor,Area, Supplementary Motor,Brodmann's Area 6s,Brodmanns Area 4,Brodmanns Area 6,Central Gyrus, Anterior,Cortex, Motor,Cortex, Precentral Motor,Cortex, Premotor,Cortex, Primary Motor,Cortex, Secondary Motor,Cortices, Secondary Motor,Gyrus, Anterior Central,Gyrus, Precentral,Motor Area, Precentral,Motor Area, Primary,Motor Area, Secondary,Motor Area, Somatic,Motor Areas,Motor Cortex, Precentral,Motor Cortex, Primary,Motor Cortex, Secondary,Motor Strips,Precentral Motor Areas,Precentral Motor Cortices,Premotor Areas,Primary Motor Areas,Primary Motor Cortices,Secondary Motor Area,Secondary Motor Cortices,Somatic Motor Area,Somatomotor Area,Supplementary Motor Areas
D009068 Movement The act, process, or result of passing from one place or position to another. It differs from LOCOMOTION in that locomotion is restricted to the passing of the whole body from one place to another, while movement encompasses both locomotion but also a change of the position of the whole body or any of its parts. Movement may be used with reference to humans, vertebrate and invertebrate animals, and microorganisms. Differentiate also from MOTOR ACTIVITY, movement associated with behavior. Movements
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D011930 Reaction Time The time from the onset of a stimulus until a response is observed. Response Latency,Response Speed,Response Time,Latency, Response,Reaction Times,Response Latencies,Response Times,Speed, Response,Speeds, Response
D000818 Animals Unicellular or multicellular, heterotrophic organisms, that have sensation and the power of voluntary movement. Under the older five kingdom paradigm, Animalia was one of the kingdoms. Under the modern three domain model, Animalia represents one of the many groups in the domain EUKARYOTA. Animal,Metazoa,Animalia
D001132 Arm The superior part of the upper extremity between the SHOULDER and the ELBOW. Brachium,Upper Arm,Arm, Upper,Arms,Arms, Upper,Brachiums,Upper Arms
D012371 Robotics The application of electronic, computerized control systems to mechanical devices designed to perform human functions. Formerly restricted to industry, but nowadays applied to artificial organs controlled by bionic (bioelectronic) devices, like automated insulin pumps and other prostheses. Companion Robots,Humanoid Robots,Remote Operations (Robotics),Social Robots,Socially Assistive Robots,Telerobotics,Soft Robotics,Assistive Robot, Socially,Companion Robot,Humanoid Robot,Operation, Remote (Robotics),Operations, Remote (Robotics),Remote Operation (Robotics),Robot, Companion,Robot, Humanoid,Robot, Social,Robot, Socially Assistive,Robotic, Soft,Social Robot,Socially Assistive Robot,Soft Robotic

Related Publications

Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
January 2012, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
October 2017, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
April 1988, Journal of biomedical engineering,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
January 2017, Frontiers in neurorobotics,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
April 2016, PLoS computational biology,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
January 2024, PloS one,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
January 2014, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
August 2018, Journal of neural engineering,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
October 2011, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society,
Aaron J Suminski, and Dennis C Tkach, and Andrew H Fagg, and Nicholas G Hatsopoulos
August 2019, Proceedings of the National Academy of Sciences of the United States of America,
Copied contents to your clipboard!