A multi-modal system for the retrieval of semantic video events

A framework for event detection is proposed where events, objects, and other semantic concepts are detected from video using trained classifiers. These classifiers are used to automatically annotate video with semantic labels, which in turn are used to search for new, untrained types of events and s...

Full description

Saved in:
Bibliographic Details
Published in:Computer vision and image understanding 2004-11, Vol.96 (2), p.216-236
Main Authors: Amir, Arnon, Basu, Sankar, Iyengar, Giridharan, Lin, Ching-Yung, Naphade, Milind, Smith, John R., Srinivasan, Savitha, Tseng, Belle
Format: Article
Language:English
Subjects:
Content-based video retrieval
Event detection
Multimedia indexing
Semantic video annotation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A framework for event detection is proposed where events, objects, and other semantic concepts are detected from video using trained classifiers. These classifiers are used to automatically annotate video with semantic labels, which in turn are used to search for new, untrained types of events and semantic concepts. The novelty of the approach lies in the: (1) semi-automatic construction of models of events from feature descriptors and (2) integration of content-based and concept-based querying in the search process. Speech retrieval is independently applied and combined results are produced. Results of applying these to the Search benchmark of the NIST TREC Video track 2001 are reported, and the gained experience and future work are discussed.
ISSN:1077-3142
1090-235X
DOI:10.1016/j.cviu.2004.02.006