Correlation filter tracking based on superpixel and multifeature fusion

• Published in: Optoelectronics letters 2021, Vol.17 (1), p.47-52
• Main Authors: Zhang, Hong-ying, Wang, Hui-san, He, Peng-yi
• Format: Article
• Language: English
• Subjects: Algorithms; Clustering; Correlation; Feature extraction; Histograms; Lasers; Occlusion; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; Segmentation; Tracking
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-021-9198-2

For the correlation filtering (CF) tracking algorithm is not robust enough and cannot adapt to scale changes, target occlusion (OCC) and other complex interferences. We introduce a CF tracking algorithm based on superpixel and multifeature fusion (CFSMF). First, superpixel segmentation and clustering are performed for the target and its surrounding environment in the initial frame. Then, a target appearance is reconstructed through block segmentation-based overlapping analysis to remove redundant information. On this basis, the histogram of gradient (HOG) and HSI color features of the target sub-block are extracted to interact with their respective position filters. Accordingly, the target position is determined by the weighted fusion of the response values. In the scale prediction stage, we independently train a scale filter with a multiscale pyramid constructed at the estimated target location. The object scale is estimated in terms of the filter response, thereby enabling the tracking algorithm to adapt to the object scale change. Lastly, we introduce an OCC criterion for determining whether to update the model or not. Compared with the classical tracking algorithm kernelized correlation filters (KCF), the proposed algorithm boosts the tracking success rate by 20% and tracking accuracy by 15.9%. Our algorithm in this paper could track the target stably even when the target is occluded and its scale changes.