Remote Sensing Multimodal Image Matching Based on Structure Feature and Learnable Matching Network

• Published in: Applied sciences 2023-07, Vol.13 (13), p.7701
• Main Authors: Han, Songlai, Liu, Xuesong, Dong, Jing, Liu, Haiqiao
• Format: Article
• Language: English
• Subjects: Algorithms; Datasets; Deep learning; Gabor filters; Infrared imagery; Methods; multimodal image; principal component analysis; Principal components analysis; Radar imaging; Remote sensing; remotely sensed image; Sensors; structure feature; Synthetic aperture radar; Template matching
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app13137701

Matching remotely sensed multimodal images is a crucial process that poses significant challenges due to nonlinear radiometric differences and substantial image noise. To overcome these difficulties, this study presents a novel and practical template-matching algorithm specifically designed for this purpose. Unlike traditional approaches that rely on image intensity, the proposed algorithm focuses on matching multimodal images based on their geometric structure information. This approach enables the method to effectively adapt to variations in grayscale caused by radiometric differences. To enhance the matching performance, principal component analysis calculation based on the log-Gabor filter is proposed to estimate the structural feature of the image. The proposed method can estimate the structure feature accurately even under severe noise distortion. In addition, a learnable matching network is proposed for similarity measuring to adapt to the gradient reversal caused by the radiometric difference among remotely sensed multimodal images. Infrared, visible light, and synthetic aperture radar images are adopted for the evaluation, to verify the performance of the proposed algorithm. Based on the results, the proposed algorithm has a distinct advantage over other state-of-the-art template-matching algorithms.