Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People. 2023

Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
Department of Computer Engineering, Gachon University, Seongnam 13120, Republic of Korea.

Current artificial intelligence systems for determining a person's emotions rely heavily on lip and mouth movement and other facial features such as eyebrows, eyes, and the forehead. Furthermore, low-light images are typically classified incorrectly because of the dark region around the eyes and eyebrows. In this work, we propose a facial emotion recognition method for masked facial images using low-light image enhancement and feature analysis of the upper features of the face with a convolutional neural network. The proposed approach employs the AffectNet image dataset, which includes eight types of facial expressions and 420,299 images. Initially, the facial input image's lower parts are covered behind a synthetic mask. Boundary and regional representation methods are used to indicate the head and upper features of the face. Secondly, we effectively adopt a facial landmark detection method-based feature extraction strategy using the partially covered masked face's features. Finally, the features, the coordinates of the landmarks that have been identified, and the histograms of the oriented gradients are then incorporated into the classification procedure using a convolutional neural network. An experimental evaluation shows that the proposed method surpasses others by achieving an accuracy of 69.3% on the AffectNet dataset.

UI MeSH Term Description Entries
D004644 Emotions Those affective states which can be experienced and have arousing and motivational properties. Feelings,Regret,Emotion,Feeling,Regrets
D005149 Facial Expression Observable changes of expression in the face in response to emotional stimuli. Face Expression,Expression, Face,Expression, Facial,Face Expressions,Facial Expressions
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000066499 Facial Recognition Ability to identify an individual from their facial features. Face Emotion Perception,Face Emotion Processing,Face Emotion Recognition,Face Processing,Face Recognition,Facial Emotion Recognition,Facial Expression Recognition,Facial Identity Recognition,Face Perception,Emotion Perception, Face,Emotion Processing, Face,Emotion Recognition, Face,Emotion Recognition, Facial,Expression Recognition, Facial,Identity Recognition, Facial,Perception, Face,Perception, Face Emotion,Processing, Face,Processing, Face Emotion,Recognition, Face,Recognition, Face Emotion,Recognition, Facial,Recognition, Facial Emotion,Recognition, Facial Expression,Recognition, Facial Identity
D000077321 Deep Learning Supervised or unsupervised machine learning methods that use multiple layers of data representations generated by nonlinear transformations, instead of individual task-specific ALGORITHMS, to build and train neural network models. Hierarchical Learning,Learning, Deep,Learning, Hierarchical
D001185 Artificial Intelligence Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language. AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
August 2022, Sensors (Basel, Switzerland),
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
January 2018, Technology and health care : official journal of the European Society for Engineering and Medicine,
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
June 2023, Heliyon,
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
October 2020, Sensors (Basel, Switzerland),
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
June 2023, Sensors (Basel, Switzerland),
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
January 2022, Applied intelligence (Dordrecht, Netherlands),
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
March 2022, Computer methods and programs in biomedicine,
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
October 2023, Entropy (Basel, Switzerland),
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
February 2024, Mathematical biosciences and engineering : MBE,
Mukhriddin Mukhiddinov, and Oybek Djuraev, and Farkhod Akhmedov, and Abdinabi Mukhamadiyev, and Jinsoo Cho
April 2023, Computers in biology and medicine,
Copied contents to your clipboard!