Hierarchical Ensemble of Background Models for PTZ-Based Video Surveillance

In this paper, we study a novel hierarchical background model for intelligent video surveillance with the pan-tilt-zoom (PTZ) camera, and give rise to an integrated system consisting of three key components: background modeling, observed frame registration, and object tracking. First, we build the h...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on cybernetics 2015-01, Vol.45 (1), p.89-102
Main Authors: Liu, Ning, Wu, Hefeng, Lin, Liang
Format: Article
Language:English
Subjects:
Buildings
Cameras
Computational modeling
Construction
Frames
Hierarchical background modeling
Mathematical models
object localization
Object tracking
Partitioning
PTZ camera surveillance
Robustness
Searching
Surveillance
Target tracking
Tracking
video tracking
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we study a novel hierarchical background model for intelligent video surveillance with the pan-tilt-zoom (PTZ) camera, and give rise to an integrated system consisting of three key components: background modeling, observed frame registration, and object tracking. First, we build the hierarchical background model by separating the full range of continuous focal lengths of a PTZ camera into several discrete levels and then partitioning the wide scene at each level into many partial fixed scenes. In this way, the wide scenes captured by a PTZ camera through rotation and zoom are represented by a hierarchical collection of partial fixed scenes. A new robust feature is presented for background modeling of each partial scene. Second, we locate the partial scenes corresponding to the observed frame in the hierarchical background model. Frame registration is then achieved by feature descriptor matching via fast approximate nearest neighbor search. Afterwards, foreground objects can be detected using background subtraction. Last, we configure the hierarchical background model into a framework to facilitate existing object tracking algorithms under the PTZ camera. Foreground extraction is used to assist tracking an object of interest. The tracking outputs are fed back to the PTZ controller for adjusting the camera properly so as to maintain the tracked object in the image plane. We apply our system on several challenging scenarios and achieve promising results.
ISSN:2168-2267
2168-2275
DOI:10.1109/TCYB.2014.2320493