Spectroformer: Multi-Domain Query Cascaded Transformer Network For Underwater Image Enhancement

• Main Authors: Khan, Md Raqib, Mishra, Priyanka, Mehta, Nancy, Phutke, Shruti S., Vipparthi, Santosh Kumar, Nandi, Sukumar, Murala, Subrahmanyam
• Format: Conference Proceeding
• Language: English
• Subjects: Algorithms; Codes; Computer vision; Distortion; Estimation; Image color analysis; Image recognition and understanding; Lighting; Transformers; Video recognition and understanding
• ISSN: 2642-9381
• DOI: 10.1109/WACV57701.2024.00148

Underwater images often suffer from color distortion, haze, and limited visibility due to light refraction and absorption in water. These challenges significantly impact autonomous underwater vehicle applications, necessitating efficient image enhancement techniques. To address these challenges, we propose a Multi-Domain Query Cascaded Transformer Network for underwater image enhancement. Our approach includes a novel Multi-Domain Query Cascaded Attention mechanism that integrates localized transmission features and global illumination features. To improve feature propagation from the encoder to the decoder, we propose a Spatio-Spectro Fusion-Based Attention Block. Additionally, we introduce a Hybrid Fourier-Spatial Up-sampling Block, which uniquely combines Fourier and spatial upsampling techniques to enhance feature resolution effectively. We evaluate our method on benchmark synthetic and real-world underwater image datasets, demonstrating its superiority through extensive ablation studies and comparative analysis. The testing code is available at: https://github.com/Mdraqibkhan/Spectroformer.