Neither Global Nor Local: Regularized Patch-Based Representation for Single Sample Per Person Face Recognition

• Published in: International journal of computer vision 2015-02, Vol.111 (3), p.365-383
• Main Authors: Gao, Shenghua, Jia, Kui, Zhuang, Liansheng, Ma, Yi
• Format: Article
• Language: English
• Subjects: Analysis; Artificial Intelligence; Biometry; Collaboration; Computer Imaging; Computer Science; Dictionaries; Face; Face recognition; Facial recognition technology; Galleries; Image Processing and Computer Vision; Image processing systems; Image reconstruction; Methods; Pattern Recognition; Pattern Recognition and Graphics; Principal components analysis; Reconstruction; Regularization methods; Representations; Sparsity; Studies; Variance; Vision
• ISSN: 0920-5691; 1573-1405
• DOI: 10.1007/s11263-014-0750-4

This paper presents a regularized patch-based representation for single sample per person face recognition. We represent each image by a collection of patches and seek their sparse representations under the gallery images patches and intra-class variance dictionaries at the same time. For the reconstruction coefficients of all the patches from the same image, by imposing a group sparsity constraint on the reconstruction coefficients corresponding to the patches from the gallery images, and by imposing a sparsity constraint on the reconstruction coefficients corresponding to the intra-class variance dictionaries, our formulation harvests the advantages of both patch-based image representation and global image representation, i.e. our method overcomes the side effect of those patches which are severely corrupted by the variances in face recognition, while enforcing those less discriminative patches to be constructed by the gallery patches from the right person. Moreover, instead of using the manually designed intra-class variance dictionaries, we propose to learn the intra-class variance dictionaries which not only greatly accelerate the prediction of the probe images but also improve the face recognition accuracy in the single sample per person scenario. Experimental results on the AR, Extended Yale B, CMU-PIE, and LFW datasets show that our method outperforms sparse coding related face recognition methods as well as some other specially designed single sample per person face representation methods, and achieves the best performance. These encouraging results demonstrate the effectiveness of regularized patch-based face representation for single sample per person face recognition.