An Infrared Sequence Image Generating Method for Target Detection and Tracking

Training infrared target detection and tracking models based on deep learning requires a large number of infrared sequence images. The cost of acquisition real infrared target sequence images is high, while conventional simulation methods lack authenticity. This paper proposes a novel infrared data...

Full description

Saved in:
Bibliographic Details
Published in:Frontiers in computational neuroscience 2022-07, Vol.16, p.930827-930827
Main Authors: Zhijian, Huang, Bingwei, Hui, Shujin, Sun
Format: Article
Language:English
Subjects:
Aircraft
Attitudes
Authenticity
Deep learning
Editing
Heat
infrared image simulation
Infrared radiation
infrared target simulation
Methods
Neuroscience
Simulation
Skin
Unity3D
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Training infrared target detection and tracking models based on deep learning requires a large number of infrared sequence images. The cost of acquisition real infrared target sequence images is high, while conventional simulation methods lack authenticity. This paper proposes a novel infrared data simulation method that combines real infrared images and simulated 3D infrared targets. Firstly, it stitches real infrared images into a panoramic image which is used as background. Then, the infrared characteristics of 3D aircraft are simulated on the tail nozzle, skin, and tail flame, which are used as targets. Finally, the background and targets are fused based on Unity3D, where the aircraft trajectory and attitude can be edited freely to generate rich multi-target infrared data. The experimental results show that the simulated image is not only visually similar to the real infrared image but also consistent with the real infrared image in terms of the performance of target detection algorithms. The method can provide training and testing samples for deep learning models for infrared target detection and tracking.
ISSN:1662-5188
1662-5188
DOI:10.3389/fncom.2022.930827