MSF-IOF: A Novel ISAR-and-optical Image Fusion Method Based on Features of Multi-sub-bands

Inverse synthetic aperture radar (ISAR) images and optical images exhibit a certain degree of complementarity due to their imaging in different microwave frequency bands. To enhance the representation capability of spacecraft structures and details, we propose a novel ISAR-and-optical image fusion m...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on geoscience and remote sensing 2024-12, p.1-1
Main Authors: Wang, Ze, Liu, Lei, Du, Rongzhen, Zhang, Zhenxi, Zhou, Wanting, Sun, Yunan, Cai, Jingjing, Zhou, Feng
Format: Article
Language:English
Subjects:
Adaptive optics
Biomedical optical imaging
Image fusion
Image registration
Imaging
ISAR image
NSST
optical image
Optical imaging
Optical scattering
Optical sensors
PADCPCNN
Space vehicles
Transforms
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Inverse synthetic aperture radar (ISAR) images and optical images exhibit a certain degree of complementarity due to their imaging in different microwave frequency bands. To enhance the representation capability of spacecraft structures and details, we propose a novel ISAR-and-optical image fusion method based on features of multi-sub-bands. Firstly, given the different imaging planes of spacecraft in ISAR and optical images, we propose an ISAR-and-optical image registration method that combines key-point detection and homography transformation, based on the obvious geometric features of the spacecraft. Secondly, the multiscale decomposition of the source images is achieved by the non-subsampled shearlet transform (NSST). Subsequently, we propose a novel activity level measurement function based on brightness, contours, and textures to achieve the fusion of low-pass sub-bands. Simultaneously, the texture of high-pass sub-bands is effectively fused based on the parameter-adaptive dual-channel pulse-coupled neural network (PADCPCNN). Finally, the fused image is obtained by the inverse-NSST. Compared to the existing state-of-the-art fusion methods, the proposed method has better performance in both qualitative and quantitative evaluations across multiple imaging instants for different satellite models.
ISSN:0196-2892
DOI:10.1109/TGRS.2024.3519955