Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering

This paper presents algorithms and a prototype system for hand tracking and hand posture recognition. Hand postures are represented in terms of hierarchies of multi-scale colour image features at different scales, with qualitative inter-relations in terms of scale, position and orientation. In each...

Full description

Saved in:
Bibliographic Details
Main Authors: Bretzner, L., Laptev, I., Lindeberg, T.
Format: Conference Proceeding
Language:English
Subjects:
Computer vision
Control systems
Electronic equipment testing
Filtering
Image sampling
Particle tracking
Prototypes
Real time systems
Skin
System testing
Citations: Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents algorithms and a prototype system for hand tracking and hand posture recognition. Hand postures are represented in terms of hierarchies of multi-scale colour image features at different scales, with qualitative inter-relations in terms of scale, position and orientation. In each image, detection of multi-scale colour features is performed. Hand states are then simultaneously detected and tracked using particle filtering, with an extension of layered sampling referred to as hierarchical layered sampling. Experiments are presented showing that the performance of the system is substantially improved by performing feature detection in colour space and including a prior with respect to skin colour. These components have been integrated into a real-time prototype system, applied to a test problem of controlling consumer electronics using hand gestures. In a simplified demo scenario, this system has been successfully tested by participants at two fairs during 2001.
DOI:10.1109/AFGR.2002.1004190