CASSANDRA: audio-video sensor fusion for aggression detection

This paper presents a smart surveillance system named CASSANDRA, aimed at detecting instances of aggressive human behavior in public environments. A distinguishing aspect of CASSANDRA is the exploitation of the complimentary nature of audio and video sensing to disambiguate scene activity in real-li...

Full description

Saved in:
Bibliographic Details
Main Authors: Zajdel, W., Krijnders, J.D., Andringa, T., Gavrila, D.M.
Format: Conference Proceeding
Language:English
Subjects:
Aggregates
Artificial intelligence
Bayesian methods
Frequency
Humans
Kinetic energy
Layout
Sensor fusion
Speech
Surveillance
Citations: Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a smart surveillance system named CASSANDRA, aimed at detecting instances of aggressive human behavior in public environments. A distinguishing aspect of CASSANDRA is the exploitation of the complimentary nature of audio and video sensing to disambiguate scene activity in real-life, noisy and dynamic environments. At the lower level, independent analysis of the audio and video streams yields intermediate descriptors of a scene like: "scream", "passing train" or "articulation energy". At the higher level, a Dynamic Bayesian Network is used as a fusion mechanism that produces an aggregate aggression indication for the current scene. Our prototype system is validated on a set of scenarios performed by professional actors at an actual train station to ensure a realistic audio and video noise setting.
DOI:10.1109/AVSS.2007.4425310