Toward Pose-Invariant 2-D Face Recognition Through Point Distribution Models and Facial Symmetry

This paper proposes novel ways to deal with pose variations in a 2-D face recognition scenario. Using a training set of sparse face meshes, we built a point distribution model and identified the parameters which are responsible for controlling the apparent changes in shape due to turning and nodding...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on information forensics and security 2007-09, Vol.2 (3), p.413-429
Main Authors: Gonzalez-Jimenez, D., Alba-Castro, J.L.
Format: Article
Language:English
Subjects:
CMU PIE database
Face recognition
Facial
facial symmetry
Feature extraction
Filtering
Finite element method
Gabor filters
Gabor jets
Head
Image databases
Mathematical models
point distribution models
pose-invariant face recognition
Shape control
Spline
Statistical analysis
Symmetry
thin-plate splines
Turning
XM2VTS database
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper proposes novel ways to deal with pose variations in a 2-D face recognition scenario. Using a training set of sparse face meshes, we built a point distribution model and identified the parameters which are responsible for controlling the apparent changes in shape due to turning and nodding the head, namely the pose parameters. Based on them, we propose two approaches for pose correction: 1) a method in which the pose parameters from both meshes are set to typical values of frontal faces, and 2) a method in which one mesh adopts the pose parameters of the other one. Finally, we obtain pose corrected meshes and, taking advantage of facial symmetry, virtual views are synthesized via Thin Plate Splines-based warping. Given that the corrected images are not embedded into a constant reference frame, holistic methods are not suitable for feature extraction. Instead, the virtual faces are fed into a system that makes use of Gabor filtering for recognition. Unlike other approaches that warp faces onto a mean shape, we show that if only pose parameters are modified, client specific information remains in the warped image and discrimination between subjects is more reliable. Statistical analysis of the authentication results obtained on the XM2VTS database confirm the hypothesis. Also, the CMU PIE database is used to assess the performance of the proposed methods in an identification scenario where large pose variations are present, achieving state-of-the-art results and outperforming both research and commercial techniques.
ISSN:1556-6013
1556-6021
DOI:10.1109/TIFS.2007.903543