Real-time estimation of long-term 3-D motion parameters for SNHC face animation and model-based coding applications

We present two recursive methods for the real-time estimation of long-term three-dimensional (3-D) motion parameters from monocular image sequences suitable for synthetic/natural hybrid coding face animation and model-based coding applications. Based on feature point extractions in energy frame, the...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 1999-03, Vol.9 (2), p.255-263
Main Authors: Smolic, A., Makai, B., Sikora, T.
Format: Article
Language:English
Subjects:
Animation
Application software
Circuits
Coding
Face
Facial animation
Humans
Image coding
Image sequences
Least squares method
Least squares methods
Mathematical models
Motion estimation
MPEG 4 Standard
Real time
Recursive
Recursive estimation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present two recursive methods for the real-time estimation of long-term three-dimensional (3-D) motion parameters from monocular image sequences suitable for synthetic/natural hybrid coding face animation and model-based coding applications. Based on feature point extractions in energy frame, the 3-D motion parameters of a human face are estimated with a predictive approach. The first method uses a recursive linear least squares approach and the second employs a nonlinear extended Kalman filter, which does not rely on a linearized model of the face motion. Both methods perform a prediction and correction loop at every time step. Compared to other methods described in the literature, the recursive and predictive structure of the proposed estimation process solves the problem of error accumulation in long-term motion estimation. This makes the estimation stable and consistent over long periods. Experimental results are presented for synthetic data and real image sequences, which demonstrate the performance of the estimation methods and compare the two approaches.
ISSN:1051-8215
1558-2205
DOI:10.1109/76.752093