High resolution passive facial performance capture

We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on graphics 2010-07, Vol.29 (4)
Main Authors: Bradley, Derek, Heidrich, Wolfgang, Popa, Tiberiu, Sheffer, Alla
Format: Article
Language:English
Subjects:
Arrays
Cameras
Facial
Illumination
Markers
Surface layer
Texture
Tracking
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking texture detail across the frames. As a result, we obtain a high-resolution sequence of compatibly triangulated and parameterized meshes. The resulting sequence can be rendered with dynamically captured textures, while also consistently applying texture changes such as virtual makeup.
ISSN:0730-0301
DOI:10.1145/1667239.1667251