Perceptual-based hyperspectral image fusion using multiresolution analysis

• Published in: Optical Engineering 1995-11, Vol.34 (11), p.3154-3164
• Main Authors: Wilson, Terry A, Rogers, Steven K, Myers, Jr, Lemuel R
• Format: Article
• Language: English
• ISSN: 0091-3286; 1560-2303
• DOI: 10.1117/12.213617

A perceptual-based multiresolution image fusion technique is demonstrated using the Airborne Visible and Infrared Imaging Spectrometer (AVIRIS) hyperspectral sensor data. The AVIRIS sensor, which simultaneously collects information in 224 spectral bands that range from 0.4 to 2.5 microns in approximately 10-nm increments, produces 224 images, each representing a single spectral band. The fusion algorithm consists of three stages. First, a Daubechies orthogonal wavelet basis set is used to perform a multiresolution decomposition of each spectral image. Next, the coefficients from each image are combined using a perceptual-based weighting. The weighting of each coefficient, from a given spectral band image, is determined by the spatial-frequency response (contrast sensitivity) of the human visual system. The spectral image with the higher saliency value, where saliency is based on a perceptual energy, will receive the larger weight. Finally, the fused coefficients are used for reconstruction to obtain the fused image. The image fusion algorithm is analyzed using test images with known image characteristics and image data from the AVIRIS hyperspectral sensor. By analyzing the SNRs and visual aesthetics of the fused images, contrast-sensitivity-based fusion is shown to provide excellent fusion results and to outperform previous fusion methods. (Author)