A Memory-Efficient High-Speed Event-based Object Tracking System

• Main Authors: Lu, Yuncheng, Cui, Kaixiang, Shi, Yucen, Li, Zehao, Li, Junying, Lu, Wenhao, Zheng, Yuanjin, Kim, Tony Tae-Hyoung
• Format: Conference Proceeding
• Language: English
• Subjects: Dynamic vision sensors (DVS); Heuristic algorithms; low latency; memory-efficient; Noise reduction; Object detection; Object tracking; Power demand; region proposal; single scan; System-on-chip; Vision sensors
• ISSN: 2158-1525
• DOI: 10.1109/ISCAS58744.2024.10558212

Dynamic vision sensors (DVS) have become prevalent in edge vision applications due to their low power and short latency attributes. However, current DVS-based object tracking systems suffer from high power consumption or long processing latency due to high computing intensity of the object detection algorithms. This paper proposes an energy-efficient object detection system through algorithm and hardware co-optimization. We design hardware-efficient denoising and region proposal (RP) algorithms to reduce on-chip memory usage and power consumption. Besides, the processing latency is dramatically reduced thanks to the less computing complexity. The devised algorithm is executed on a heterogeneous platform, with segments particularly sensitive to latency being accelerated via FPGA. An RP processor, supporting both parallel and systolic computing modes, is developed to facilitate the computing-intensive RP generation. Remarkably, the proposed system reduces the on-chip memory by 95.3% in contrast to traditional methods that employ connected component labeling. Moreover, the processing time per frame stands at 92.2 ms, marking a reduction of 82.4% compared to CPU-only operations.