Heterogeneous CPU–GPU tracking–learning–detection (H-TLD) for real-time object tracking

• Published in: Journal of real-time image processing 2019-04, Vol.16 (2), p.339-353
• Main Authors: Gurcan, Ilker, Temizel, Alptekin
• Format: Article
• Language: English
• Subjects: Algorithms; Central processing units; Computer Graphics; Computer Science; CPUs; Data transfer (computers); Graphics processing units; Image Processing and Computer Vision; Multimedia Information Systems; Multiprocessing; Optical tracking; Optimization; Original Research Paper; Pattern Recognition; Sensors; Signal,Image and Speech Processing; Source code
• ISSN: 1861-8200; 1861-8219
• DOI: 10.1007/s11554-015-0538-y

The recently proposed tracking–learning–detection (TLD) method has become a popular visual tracking algorithm as it was shown to provide promising long-term tracking results. On the other hand, the high computational cost of the algorithm prevents it being used at higher resolutions and frame rates. In this paper, we describe the design and implementation of a heterogeneous CPU–GPU TLD (H-TLD) solution using OpenMP and CUDA. Leveraging the advantages of the heterogeneous architecture, serial parts are run asynchronously on the CPU while the most computationally costly parts are parallelized and run on the GPU. Design of the solution ensures keeping data transfers between CPU and GPU at a minimum and applying stream compaction and overlapping data transfer with computation whenever such transfers are necessary. The workload is balanced for a uniform work distribution across the GPU multiprocessors. Results show that 10.25 times speed-up is achieved at 1920  ×  1080 resolution compared to the baseline TLD. The source code has been made publicly available to download from the following address: http://gpuresearch.ii.metu.edu.tr/codes/ .