A suspicious behaviour detection using a context space model for smart surveillance systems

• Published in: Computer vision and image understanding 2012-02, Vol.116 (2), p.194-209
• Main Authors: Wiliem, Arnold, Madasu, Vamsi, Boles, Wageeh, Yarlagadda, Prasad
• Format: Article
• Language: English
• Subjects: Algorithms; Applied sciences; Artificial intelligence; Cameras; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Context; Data processing. List processing. Character string processing; Exact sciences and technology; Fatigue (materials); Feedback; Human behavior; Inference; Memory organisation. Data processing; Pattern recognition. Digital image processing. Computational geometry; Security; Software; Surveillance system; Surveillance systems; Suspicious behaviour
• ISSN: 1077-3142; 1090-235X
• DOI: 10.1016/j.cviu.2011.10.001

► We propose a context based system for detecting suspicious behaviour. ► We propose a context space model for distinguishing between different contexts. ► We propose the use of data stream clustering for updating and retrieving knowledge. ► We propose an inference algorithm for making correct context-sensitive decisions. Video surveillance systems using Closed Circuit Television (CCTV) cameras, is one of the fastest growing areas in the field of security technologies. However, the existing video surveillance systems are still not at a stage where they can be used for crime prevention. The systems rely heavily on human observers and are therefore limited by factors such as fatigue and monitoring capabilities over long periods of time. This work attempts to address these problems by proposing an automatic suspicious behaviour detection which utilises contextual information. The utilisation of contextual information is done via three main components: a context space model, a data stream clustering algorithm, and an inference algorithm. The utilisation of contextual information is still limited in the domain of suspicious behaviour detection. Furthermore, it is nearly impossible to correctly understand human behaviour without considering the context where it is observed. This work presents experiments using video feeds taken from CAVIAR dataset and a camera mounted on one of the buildings Z-Block) at the Queensland University of Technology, Australia. From these experiments, it is shown that by exploiting contextual information, the proposed system is able to make more accurate detections, especially of those behaviours which are only suspicious in some contexts while being normal in the others. Moreover, this information gives critical feedback to the system designers to refine the system.