An occlusion-aware particle filter tracker to handle complex and persistent occlusions

•Enhanced particle filter tracker by latent occlusion flag to handle full occlusion.•Handled persistent and/or complex occlusions in RGBD sequences.•Developed data-driven occlusion mask to evaluate various parts of observation.•Fused multiple feature from color and depth domains to gain occlusion ro...

Full description

Saved in:
Bibliographic Details
Published in:Computer vision and image understanding 2016-09, Vol.150, p.81-94
Main Authors: Meshgi, Kourosh, Maeda, Shin-ichi, Oba, Shigeyuki, Skibbe, Henrik, Li, Yu-zhe, Ishii, Shin
Format: Article
Language:English
Subjects:
Algorithms
Explicit occlusion handling
Illumination
Mathematical models
Occlusion
Particle filter tracker
Probabilistic methods
Probability theory
RGBD tracking
Searching
Tracking
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:•Enhanced particle filter tracker by latent occlusion flag to handle full occlusion.•Handled persistent and/or complex occlusions in RGBD sequences.•Developed data-driven occlusion mask to evaluate various parts of observation.•Fused multiple feature from color and depth domains to gain occlusion robustness. Although appearance-based trackers have been greatly improved in the last decade, they still struggle with challenges that are not fully resolved. Of these challenges, occlusions, which can be long lasting and of a wide variety, are often ignored or only partly addressed due to the difficulty in their treatments. To address this problem, in this study, we propose an occlusion-aware particle filter framework that employs a probabilistic model with a latent variable representing an occlusion flag. The proposed framework prevents losing the target by prediction of emerging occlusions, updates the target template by shifting relevant information, expands the search area for an occluded target, and grants quick recovery of the target after occlusion. Furthermore, the algorithm employs multiple features from the color and depth domains to achieve robustness against illumination changes and clutter, so that the probabilistic framework accommodates the fusion of those features. This method was applied to the Princeton RGBD Tracking Dataset, and the performance of our method with different sets of features was compared with those of the state-of-the-art trackers. The results revealed that our method outperformed the existing RGB and RGBD trackers by successfully dealing with different types of occlusions.
ISSN:1077-3142
1090-235X
DOI:10.1016/j.cviu.2016.05.011