Towards human motion capture from a camera mounted on a mobile robot

This article describes a multiple feature data fusion applied to a particle filter for marker-less human motion capture (HMC) by using a single camera devoted to an assistant mobile robot. Particle filters have proved to be well suited to this robotic context. Like numerous approaches, the principle...

Full description

Saved in:
Bibliographic Details
Published in:Image and vision computing 2011-05, Vol.29 (6), p.382-393
Main Authors: Menezes, Paulo, Lerasle, Frédéric, Dias, Jorge
Format: Article
Language:English
Subjects:
Assistant robot
Cameras
Computer vision
Data fusion
Data integration
Human
Human motion
Human motion capture
Mathematical models
Particle filtering
Robots
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article describes a multiple feature data fusion applied to a particle filter for marker-less human motion capture (HMC) by using a single camera devoted to an assistant mobile robot. Particle filters have proved to be well suited to this robotic context. Like numerous approaches, the principle relies on the projection of the model's silhouette of the tracked human limbs and appearance features located on the model surface, to validate the particles (associated configurations) which correspond to the best model-to-image fits. Our particle filter based HMC system is improved and extended in two ways. First, our estimation process is based on the so-called AUXILIARY scheme which has been surprisingly seldom exploited for tracking purpose. This scheme is shown to outperform conventional particle filters as it limits drastically the well-known burst in term of particles when considering high dimensional state-space. The second line of investigation concerns data fusion. Data fusion is considered both in the importance and measurement functions with some degree of adaptability depending on the current human posture and the environmental context encountered by the robot. Implementation and experiments on indoor sequences acquired by an assistant mobile robot highlight the relevance and versatility of our HMC system. Extensions are finally discussed. [Display omitted] ► 3D tracking of the human upper limbs x from monocular video sequences. ► Two stage integration of image cues in Auxiliary Particle Filter Framework to improve robustness of the the tracker. ► Tuneable measurement function that ia able to fuse both image-based information with model-related constraints.
ISSN:0262-8856
1872-8138
DOI:10.1016/j.imavis.2011.01.003