Temporal segmentation and activity classification from first-person sensing

Temporal segmentation of human motion into actions is central to the understanding and building of computational models of human motion and activity recognition. Several issues contribute to the challenge of temporal segmentation and classification of human motion. These include the large variabilit...

Full description

Saved in:
Bibliographic Details
Main Authors: Spriggs, Ekaterina H, De La Torre, Fernando, Hebert, Martial
Format: Conference Proceeding
Language:English
Subjects:
Cameras
Computational modeling
Computer graphics
Computer vision
Hidden Markov models
Humans
Measurement units
Motion analysis
Motion detection
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Temporal segmentation of human motion into actions is central to the understanding and building of computational models of human motion and activity recognition. Several issues contribute to the challenge of temporal segmentation and classification of human motion. These include the large variability in the temporal scale and periodicity of human actions, the complexity of representing articulated motion, and the exponential nature of all possible movement combinations. We provide initial results from investigating two distinct problems -classification of the overall task being performed, and the more difficult problem of classifying individual frames over time into specific actions. We explore first-person sensing through a wearable camera and inertial measurement units (IMUs) for temporally segmenting human motion into actions and performing activity classification in the context of cooking and recipe preparation in a natural environment. We present baseline results for supervised and unsupervised temporal segmentation, and recipe recognition in the CMU-multimodal activity database (CMU-MMAC).
ISSN:2160-7508
2160-7516
DOI:10.1109/CVPRW.2009.5204354