Source Aware Deep Learning Framework for Hand Kinematic Reconstruction Using EEG Signal. 2023

Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy

The ability to reconstruct the kinematic parameters of hand movement using noninvasive electroencephalography (EEG) is essential for strength and endurance augmentation using exoskeleton/exosuit. For system development, the conventional classification-based brain-computer interface (BCI) controls external devices by providing discrete control signals to the actuator. A continuous kinematic reconstruction from EEG signal is better suited for practical BCI applications. The state-of-the-art multivariable linear regression (mLR) method provides a continuous estimate of hand kinematics, achieving a maximum correlation of up to 0.67 between the measured and the estimated hand trajectory. In this work, three novel source aware deep learning models are proposed for motion trajectory prediction (MTP). In particular, multilayer perceptron (MLP), convolutional neural network-long short-term memory (CNN-LSTM), and wavelet packet decomposition (WPD) for CNN-LSTM are presented. In addition, novelty in the work includes the utilization of brain source localization (BSL) [using standardized low-resolution brain electromagnetic tomography (sLORETA)] for the reliable decoding of motor intention. The information is utilized for channel selection and accurate EEG time segment selection. The performance of the proposed models is compared with the traditionally utilized mLR technique on the reach, grasp, and lift (GAL) dataset. The effectiveness of the proposed framework is established using the Pearson correlation coefficient (PCC) and trajectory analysis. A significant improvement in the correlation coefficient is observed when compared with the state-of-the-art mLR model. Our work bridges the gap between the control and the actuator block, enabling real-time BCI implementation.

UI MeSH Term Description Entries
D004569 Electroencephalography Recording of electric currents developed in the brain by means of electrodes applied to the scalp, to the surface of the brain, or placed within the substance of the brain. EEG,Electroencephalogram,Electroencephalograms
D006225 Hand The distal part of the arm beyond the wrist in humans and primates, that includes the palm, fingers, and thumb. Hands
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D001696 Biomechanical Phenomena The properties, processes, and behavior of biological systems under the action of mechanical forces. Biomechanics,Kinematics,Biomechanic Phenomena,Mechanobiological Phenomena,Biomechanic,Biomechanic Phenomenas,Phenomena, Biomechanic,Phenomena, Biomechanical,Phenomena, Mechanobiological,Phenomenas, Biomechanic
D062207 Brain-Computer Interfaces Instrumentation consisting of hardware and software that communicates with the BRAIN. The hardware component of the interface records brain signals, while the software component analyzes the signals and converts them into a command that controls a device or sends a feedback signal to the brain. Brain Machine Interface,Brain-Computer Interface,Brain-Machine Interfaces,Brain Computer Interface,Brain Computer Interfaces,Brain Machine Interfaces,Brain-Machine Interface,Interface, Brain Machine,Interface, Brain-Computer,Interface, Brain-Machine,Interfaces, Brain Machine,Interfaces, Brain-Computer,Interfaces, Brain-Machine,Machine Interface, Brain,Machine Interfaces, Brain

Related Publications

Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
December 2021, Tomography (Ann Arbor, Mich.),
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
July 2025, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
July 2023, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
April 2019, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
March 2024, Scientific reports,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
August 2025, IEEE journal of biomedical and health informatics,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
October 2021, Brain sciences,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
September 2025, bioRxiv : the preprint server for biology,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
February 2023, Computer methods and programs in biomedicine,
Sidharth Pancholi, and Amita Giri, and Anant Jain, and Lalan Kumar, and Sitikantha Roy
March 2024, IEEE transactions on bio-medical engineering,
Copied contents to your clipboard!