Learning Pose-Aware Models for Pose-Invariant Face Recognition in the Wild. 2019

Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia

We propose a method designed to push the frontiers of unconstrained face recognition in the wild with an emphasis on extreme out-of-plane pose variations. Existing methods either expect a single model to learn pose invariance by training on massive amounts of data or else normalize images by aligning faces to a single frontal pose. Contrary to these, our method is designed to explicitly tackle pose variations. Our proposed Pose-Aware Models (PAM) process a face image using several pose-specific, deep convolutional neural networks (CNN). 3D rendering is used to synthesize multiple face poses from input images to both train these models and to provide additional robustness to pose variations at test time. Our paper presents an extensive analysis of the IARPA Janus Benchmark A (IJB-A), evaluating the effects that landmark detection accuracy, CNN layer selection, and pose model selection all have on the performance of the recognition pipeline. It further provides comparative evaluations on IJB-A and the PIPA dataset. These tests show that our approach outperforms existing methods, even surprisingly matching the accuracy of methods that were specifically fine-tuned to the target dataset. Parts of this work previously appeared in [1] and [2].

UI MeSH Term Description Entries

Related Publications

Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
October 2011, IEEE transactions on pattern analysis and machine intelligence,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
March 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
October 2007, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
July 2007, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
April 2013, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
January 2016, Computational intelligence and neuroscience,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
February 2019, Sensors (Basel, Switzerland),
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
February 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
May 2013, Neural networks : the official journal of the International Neural Network Society,
Iacopo Masi, and Feng-Ju Chang, and Jongmoo Choi, and Shai Harel, and Jungyeon Kim, and KangGeon Kim, and Jatuporn Leksut, and Stephen Rawls, and Yue Wu, and Tal Hassner, and Wael AbdAlmageed, and Gerard Medioni, and Louis-Philippe Morency, and Prem Natarajan, and Ram Nevatia
April 2018, IEEE transactions on neural networks and learning systems,
Copied contents to your clipboard!