Emotion Recognition from EEG and Facial Expressions: a Multimodal Approach. 2018

Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa

The understanding of a psychological phenomena such as emotion is of paramount importance for psychologists, since it allows to recognize a pathology and to prescribe a due treatment for a patient. While approaching this problem, mathematicians and computational science engineers have proposed different unimodal techniques for emotion recognition from voice, electroencephalography, facial expression, and physiological data. It is also well known that identifying emotions is a multimodal process. The main goal in this work is to train a computer to do so. In this paper we will present our first approach to a multimodal emotion recognition via data fusion of Electroencephalography and facial expressions. The selected strategy was a feature-level fusion of both Electroencephalography and facial microexpressions, and the classification schemes used were a neural network model and a random forest classifier. Experimental set up was out with the balanced multimodal database MAHNOB-HCI. Results are promising compared to results from other authors with a 97% of accuracy. The feature-level fusion approach used in this work improves our unimodal techniques up to 12% per emotion. Therefore, we may conclude that our simple but effective approach improves the overall results of accuracy.

UI MeSH Term Description Entries
D004569 Electroencephalography Recording of electric currents developed in the brain by means of electrodes applied to the scalp, to the surface of the brain, or placed within the substance of the brain. EEG,Electroencephalogram,Electroencephalograms
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D005149 Facial Expression Observable changes of expression in the face in response to emotional stimuli. Face Expression,Expression, Face,Expression, Facial,Face Expressions,Facial Expressions
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D016208 Databases, Factual Extensive collections, reputedly complete, of facts and data garnered from material of a specialized subject area and made available for analysis and application. The collection can be automated by various contemporary methods for retrieval. The concept should be differentiated from DATABASES, BIBLIOGRAPHIC which is restricted to collections of bibliographic references. Databanks, Factual,Data Banks, Factual,Data Bases, Factual,Data Bank, Factual,Data Base, Factual,Databank, Factual,Database, Factual,Factual Data Bank,Factual Data Banks,Factual Data Base,Factual Data Bases,Factual Databank,Factual Databanks,Factual Database,Factual Databases

Related Publications

Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2017, Computational intelligence and neuroscience,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2021, Frontiers in psychology,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
October 2025, Sensors (Basel, Switzerland),
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2012, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
October 2009, Emotion (Washington, D.C.),
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
October 2025, Sensors (Basel, Switzerland),
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2022, Frontiers in psychology,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2021, Scientific reports,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
October 2022, Psychological reports,
Valentina Chaparro, and Alejandro Gomez, and Alejandro Salgado, and O Lucia Quintero, and Natalia Lopez, and Luisa F Villa
January 2007, Neuropsychologia,
Copied contents to your clipboard!