Emotion recognition using spatial-temporal EEG features through convolutional graph attention network. 2023

Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
Tianjin Key Laboratory of Cognitive Computing and Application, College of Intelligence and Computing, Tianjin University, Tianjin 300350, People's Republic of China.

Objective.Constructing an efficient human emotion recognition model based on electroencephalogram (EEG) signals is significant for realizing emotional brain-computer interaction and improving machine intelligence.Approach.In this paper, we present a spatial-temporal feature fused convolutional graph attention network (STFCGAT) model based on multi-channel EEG signals for human emotion recognition. First, we combined the single-channel differential entropy (DE) feature with the cross-channel functional connectivity (FC) feature to extract both the temporal variation and spatial topological information of EEG. After that, a novel convolutional graph attention network was used to fuse the DE and FC features and further extract higher-level graph structural information with sufficient expressive power for emotion recognition. Furthermore, we introduced a multi-headed attention mechanism in graph neural networks to improve the generalization ability of the model.Main results.We evaluated the emotion recognition performance of our proposed model on the public SEED and DEAP datasets, which achieved a classification accuracy of 99.11% ± 0.83% and 94.83% ± 3.41% in the subject-dependent and subject-independent experiments on the SEED dataset, and achieved an accuracy of 91.19% ± 1.24% and 92.03% ± 4.57% for discrimination of arousal and valence in subject-independent experiments on DEAP dataset. Notably, our model achieved state-of-the-art performance on cross-subject emotion recognition tasks for both datasets. In addition, we gained insight into the proposed frame through both the ablation experiments and the analysis of spatial patterns of FC and DE features.Significance.All these results prove the effectiveness of the STFCGAT architecture for emotion recognition and also indicate that there are significant differences in the spatial-temporal characteristics of the brain under different emotional states.

UI MeSH Term Description Entries
D001921 Brain The part of CENTRAL NERVOUS SYSTEM that is contained within the skull (CRANIUM). Arising from the NEURAL TUBE, the embryonic brain is comprised of three major parts including PROSENCEPHALON (the forebrain); MESENCEPHALON (the midbrain); and RHOMBENCEPHALON (the hindbrain). The developed brain consists of CEREBRUM; CEREBELLUM; and other structures in the BRAIN STEM. Encephalon
D004569 Electroencephalography Recording of electric currents developed in the brain by means of electrodes applied to the scalp, to the surface of the brain, or placed within the substance of the brain. EEG,Electroencephalogram,Electroencephalograms
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D001185 Artificial Intelligence Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language. AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D021641 Recognition, Psychology The knowledge or perception that someone or something present has been previously encountered. Familiarity,Psychological Recognition,Recognition (Psychology),Psychology Recognition,Recognition, Psychological

Related Publications

Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
November 2022, IEEE journal of biomedical and health informatics,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
January 2024, Frontiers in human neuroscience,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
January 2022, Computational intelligence and neuroscience,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
June 2023, Physiological measurement,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
January 2023, Frontiers in human neuroscience,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
October 2023, Journal of neural engineering,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
December 2020, Sensors (Basel, Switzerland),
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
January 2023, Frontiers in neuroscience,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
July 2022, Journal of neuroscience methods,
Zhongjie Li, and Gaoyan Zhang, and Longbiao Wang, and Jianguo Wei, and Jianwu Dang
November 2021, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Copied contents to your clipboard!