Saliency model-based face segmentation and tracking in head-and-shoulder video sequences

In this paper, a novel face segmentation algorithm is proposed based on facial saliency map (FSM) for head-and-shoulder type video application. This method consists of three stages. The first stage is to generate the saliency map of input video image by our proposed facial attention model. In the se...

Full description

Saved in:
Bibliographic Details
Published in:Journal of visual communication and image representation 2008-07, Vol.19 (5), p.320-333
Main Authors: Li, Hongliang, Ngan, King N.
Format: Article
Language:English
Subjects:
Boundary saliency map
Face segmentation
Face tracking
Facial feature extraction
Facial saliency map
Head-and-shoulder video
Skin tone
Video segmentation
Video-conferencing
Visual attention
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, a novel face segmentation algorithm is proposed based on facial saliency map (FSM) for head-and-shoulder type video application. This method consists of three stages. The first stage is to generate the saliency map of input video image by our proposed facial attention model. In the second stage, a geometric model and an eye-map built from chrominance components are employed to localize the face region according to the saliency map. The third stage involves the adaptive boundary correction and the final face contour extraction. Based on the segmented result, an effective boundary saliency map (BSM) is then constructed, and applied for the tracking based segmentation of the successive frames. Experimental evaluation on test sequences shows that the proposed method is capable of segmenting the face area quite effectively.
ISSN:1047-3203
1095-9076
DOI:10.1016/j.jvcir.2008.04.001