Registration method for infrared and visible image of sea surface vessels based on contour feature

• Published in: Heliyon 2023-03, Vol.9 (3), p.e14166-e14166, Article e14166
• Main Authors: Dong, Yakui, Fei, Cheng, Zhao, Guopeng, Wang, Lili, Liu, Yunxia, Liu, Junliang, Fan, Shuzhen, Li, Yongfu, Zhao, Xian
• Format: Article
• Language: English
• ISSN: 2405-8440; 2405-8440
• DOI: 10.1016/j.heliyon.2023.e14166

In this paper, a modified infrared and visible image registration method based on contour feature is proposed. Our method firstly extracts the feature contour and eliminates sparkling waves contour of the sea surface, determines the main direction of the contour based on the contour image, then uses the improved Scale Invariant Feature Transform (SIFT) method as the feature point to construct the descriptor, completes the registration of the two images. 30 sets of infrared and visible-band vessels images were selected for registration experiments. Compared with previous reports, the experimental results showed that the proportion of effective feature points detected by this method can reach 70%, and the average number of effective feature points detected by proposed method can reach 196 in visible band image and 279 in infrared image. The running time was 5.3599s, shortened by 25% compared with previous reports, and the average Root Mean Square Error (RMSE) value was 2.3566, smaller by 75% compared with previous reports. An effective registration method is provided, which can be used for infrared and visible image processing and comprehensive utilization of information in marine scenes.