Real-Time Multi-Modal Estimation of Dynamically Evoked Emotions Using EEG, Heart Rate and Galvanic Skin Response. 2020

Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
Departamento de Inteligencia Artificial, UNED, Juan del Rosal, 16, Madrid, E-28040, Spain.

Emotion estimation systems based on brain and physiological signals such as electro encephalography (EEG), blood-volume pressure (BVP), and galvanic skin response (GSR) are gaining special attention in recent years due to the possibilities they offer. The field of human-robot interactions (HRIs) could benefit from a broadened understanding of the brain and physiological emotion encoding, together with the use of lightweight software and cheap wearable devices, and thus improve the capabilities of robots to fully engage with the users emotional reactions. In this paper, a previously developed methodology for real-time emotion estimation aimed for its use in the field of HRI is tested under realistic circumstances using a self-generated database created using dynamically evoked emotions. Other state-of-the-art, real-time approaches address emotion estimation using constant stimuli to facilitate the analysis of the evoked responses, remaining far from real scenarios since emotions are dynamically evoked. The proposed approach studies the feasibility of the emotion estimation methodology previously developed, under an experimentation paradigm that imitates a more realistic scenario involving dynamically evoked emotions by using a dramatic film as the experimental paradigm. The emotion estimation methodology has proved to perform on real-time constraints while maintaining high accuracy on emotion estimation when using the self-produced dynamically evoked emotions multi-signal database.

UI MeSH Term Description Entries
D002540 Cerebral Cortex The thin layer of GRAY MATTER on the surface of the CEREBRAL HEMISPHERES that develops from the TELENCEPHALON and folds into gyri and sulci. It reaches its highest development in humans and is responsible for intellectual faculties and higher mental functions. Allocortex,Archipallium,Cortex Cerebri,Cortical Plate,Paleocortex,Periallocortex,Allocortices,Archipalliums,Cerebral Cortices,Cortex Cerebrus,Cortex, Cerebral,Cortical Plates,Paleocortices,Periallocortices,Plate, Cortical
D004569 Electroencephalography Recording of electric currents developed in the brain by means of electrodes applied to the scalp, to the surface of the brain, or placed within the substance of the brain. EEG,Electroencephalogram,Electroencephalograms
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D005071 Evoked Potentials Electrical responses recorded from nerve, muscle, SENSORY RECEPTOR, or area of the CENTRAL NERVOUS SYSTEM following stimulation. They range from less than a microvolt to several microvolts. The evoked potential can be auditory (EVOKED POTENTIALS, AUDITORY), somatosensory (EVOKED POTENTIALS, SOMATOSENSORY), visual (EVOKED POTENTIALS, VISUAL), or motor (EVOKED POTENTIALS, MOTOR), or other modalities that have been reported. Event Related Potential,Event-Related Potentials,Evoked Potential,N100 Evoked Potential,P50 Evoked Potential,N1 Wave,N100 Evoked Potentials,N2 Wave,N200 Evoked Potentials,N3 Wave,N300 Evoked Potentials,N4 Wave,N400 Evoked Potentials,P2 Wave,P200 Evoked Potentials,P50 Evoked Potentials,P50 Wave,P600 Evoked Potentials,Potentials, Event-Related,Event Related Potentials,Event-Related Potential,Evoked Potential, N100,Evoked Potential, N200,Evoked Potential, N300,Evoked Potential, N400,Evoked Potential, P200,Evoked Potential, P50,Evoked Potential, P600,Evoked Potentials, N100,Evoked Potentials, N200,Evoked Potentials, N300,Evoked Potentials, N400,Evoked Potentials, P200,Evoked Potentials, P50,Evoked Potentials, P600,N1 Waves,N2 Waves,N200 Evoked Potential,N3 Waves,N300 Evoked Potential,N4 Waves,N400 Evoked Potential,P2 Waves,P200 Evoked Potential,P50 Waves,P600 Evoked Potential,Potential, Event Related,Potential, Event-Related,Potential, Evoked,Potentials, Event Related,Potentials, Evoked,Potentials, N400 Evoked,Related Potential, Event,Related Potentials, Event,Wave, N1,Wave, N2,Wave, N3,Wave, N4,Wave, P2,Wave, P50,Waves, N1,Waves, N2,Waves, N3,Waves, N4,Waves, P2,Waves, P50
D005712 Galvanic Skin Response A change in electrical resistance of the skin, occurring in emotion and in certain other conditions. Electric Conductance, Skin,Electrodermal Response,Reflex, Psychogalvanic,Skin Electric Conductance,Conductance, Skin Electric,Conductances, Skin Electric,Electric Conductances, Skin,Electrodermal Responses,Galvanic Skin Responses,Psychogalvanic Reflex,Response, Electrodermal,Response, Galvanic Skin,Responses, Electrodermal,Responses, Galvanic Skin,Skin Response, Galvanic,Skin Responses, Galvanic
D006339 Heart Rate The number of times the HEART VENTRICLES contract per unit of time, usually per minute. Cardiac Rate,Chronotropism, Cardiac,Heart Rate Control,Heartbeat,Pulse Rate,Cardiac Chronotropy,Cardiac Chronotropism,Cardiac Rates,Chronotropy, Cardiac,Control, Heart Rate,Heart Rates,Heartbeats,Pulse Rates,Rate Control, Heart,Rate, Cardiac,Rate, Heart,Rate, Pulse
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000328 Adult A person having attained full growth or maturity. Adults are of 19 through 44 years of age. For a person between 19 and 24 years of age, YOUNG ADULT is available. Adults
D012815 Signal Processing, Computer-Assisted Computer-assisted processing of electric, ultrasonic, or electronic signals to interpret function and activity. Digital Signal Processing,Signal Interpretation, Computer-Assisted,Signal Processing, Digital,Computer-Assisted Signal Interpretation,Computer-Assisted Signal Interpretations,Computer-Assisted Signal Processing,Interpretation, Computer-Assisted Signal,Interpretations, Computer-Assisted Signal,Signal Interpretation, Computer Assisted,Signal Interpretations, Computer-Assisted,Signal Processing, Computer Assisted
D016208 Databases, Factual Extensive collections, reputedly complete, of facts and data garnered from material of a specialized subject area and made available for analysis and application. The collection can be automated by various contemporary methods for retrieval. The concept should be differentiated from DATABASES, BIBLIOGRAPHIC which is restricted to collections of bibliographic references. Databanks, Factual,Data Banks, Factual,Data Bases, Factual,Data Bank, Factual,Data Base, Factual,Databank, Factual,Database, Factual,Factual Data Bank,Factual Data Banks,Factual Data Base,Factual Data Bases,Factual Databank,Factual Databanks,Factual Database,Factual Databases

Related Publications

Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
August 2016, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
June 1967, Journal of speech and hearing research,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
July 1965, Psychophysiology,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
August 1991, International journal of psychophysiology : official journal of the International Organization of Psychophysiology,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
January 1985, Fiziologiia cheloveka,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
December 2008, Physiological measurement,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
January 2001, Studies in health technology and informatics,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
July 1980, Psychophysiology,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
October 2022, Computers in biology and medicine,
Mikel Val-Calvo, and José Ramón Álvarez-Sánchez, and Jose Manuel Ferrández-Vicente, and Alejandro Díaz-Morcillo, and Eduardo Fernández-Jover
November 2021, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Copied contents to your clipboard!