Robust face tracking with a consumer depth camera

We address the problem of tracking human faces under various poses and lighting conditions. Reliable face tracking is a challenging task. The shapes of the faces may change dramatically with various identities, poses and expressions. Moreover, poor lighting conditions may cause a low contrast image...

Full description

Saved in:
Bibliographic Details
Main Authors: Fei Yang, Junzhou Huang, Xiang Yu, Xinyi Cui, Metaxas, D.
Format: Conference Proceeding
Language:English
Subjects:
Active shape model
Cameras
Depth camera
Face
Face tracking
Lighting
Real-time systems
Shape
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We address the problem of tracking human faces under various poses and lighting conditions. Reliable face tracking is a challenging task. The shapes of the faces may change dramatically with various identities, poses and expressions. Moreover, poor lighting conditions may cause a low contrast image or cast shadows on faces, which will significantly degrade the performance of the tracking system. In this paper, we develop a framework to track face shapes by using both color and depth information. Since the faces in various poses lie on a nonlinear manifold, we build piecewise linear face models, each model covering a range of poses. The low-resolution depth image is captured by using Microsoft Kinect, and is used to predict head pose and generate extra constraints at the face boundary. Our experiments show that, by exploiting the depth information, the performance of the tracking system is significantly improved.
ISSN:1522-4880
2381-8549
DOI:10.1109/ICIP.2012.6466921