LFIR-YOLO: Lightweight Model for Infrared Vehicle and Pedestrian Detection

• Published in: Sensors (Basel, Switzerland) Switzerland), 2024-10, Vol.24 (20), p.6609
• Main Authors: Wang, Quan, Liu, Fengyuan, Cao, Yi, Ullah, Farhan, Zhou, Muxiong
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Automation; C2f DWR; Cameras; CGA Fusion; Computational linguistics; Deep learning; Design; Efficiency; infrared imaging detection; Language processing; lightweight head; loss optimization; Natural language interfaces; Noise control; Pedestrians; Telecommunication systems; traffic scenes; Vehicles
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s24206609

The complexity of urban road scenes at night and the inadequacy of visible light imaging in such conditions pose significant challenges. To address the issues of insufficient color information, texture detail, and low spatial resolution in infrared imagery, we propose an enhanced infrared detection model called LFIR-YOLO, which is built upon the YOLOv8 architecture. The primary goal is to improve the accuracy of infrared target detection in nighttime traffic scenarios while meeting practical deployment requirements. First, to address challenges such as limited contrast and occlusion noise in infrared images, the C2f module in the high-level backbone network is augmented with a module, incorporating multi-scale infrared contextual information to enhance feature extraction capabilities. Secondly, at the neck of the network, a mechanism is applied to fuse features and re-modulate both initial and advanced features, catering to the low signal-to-noise ratio and sparse detail features characteristic of infrared images. Third, a shared convolution strategy is employed in the detection head, replacing the decoupled head strategy and utilizing shared and operations to achieve lightweight yet precise improvements. Finally, loss functions, and are integrated into the model to better decouple infrared targets from the background and to enhance convergence speed. The experimental results on the FLIR and multispectral datasets show that the proposed LFIR-YOLO model achieves an improvement in detection accuracy of 4.3% and 2.6%, respectively, compared to the YOLOv8 model. Furthermore, the model demonstrates a reduction in parameters and computational complexity by 15.5% and 34%, respectively, enhancing its suitability for real-time deployment on resource-constrained edge devices.