Real Time 3D Facial Movement Tracking Using a Monocular Camera

The paper proposes a robust framework for 3D facial movement tracking in real time using a monocular camera. It is designed to estimate the 3D face pose and local facial animation such as eyelid movement and mouth movement. The framework firstly utilizes the Discriminative Shape Regression method to...

Full description

Saved in:
Bibliographic Details
Published in:Sensors (Basel, Switzerland) Switzerland), 2016-07, Vol.16 (8), p.1157-1157
Main Authors: Dong, Yanchao, Wang, Yanming, Yue, Jiguang, Hu, Zhencheng
Format: Article
Language:English
Subjects:
3D facial movement
Algorithms
Animation
Cameras
Extended Kalman filter
eyelid
Face - physiology
Facial
facial animation
Facial Expression
facial feature points
Fuses
HCI
Humans
Imaging, Three-Dimensional - methods
Kalman filters
Localization
Mouth
Movement
Movement - physiology
Real time
Sensors
Three dimensional models
Three dimensional motion
Tracking
Tracking (position)
Two dimensional models
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The paper proposes a robust framework for 3D facial movement tracking in real time using a monocular camera. It is designed to estimate the 3D face pose and local facial animation such as eyelid movement and mouth movement. The framework firstly utilizes the Discriminative Shape Regression method to locate the facial feature points on the 2D image and fuses the 2D data with a 3D face model using Extended Kalman Filter to yield 3D facial movement information. An alternating optimizing strategy is adopted to fit to different persons automatically. Experiments show that the proposed framework could track the 3D facial movement across various poses and illumination conditions. Given the real face scale the framework could track the eyelid with an error of 1 mm and mouth with an error of 2 mm. The tracking result is reliable for expression analysis or mental state inference.
ISSN:1424-8220
1424-8220
DOI:10.3390/s16081157