Multistage supervised contrastive learning for hybrid-degraded image restoration

• Published in: Signal, image and video processing image and video processing, 2023-03, Vol.17 (2), p.573-581
• Main Authors: Fu, Bo, Dong, Yuhan, Fu, Shilin, Wu, Yuechu, Ren, Yonggong, Thanh, Dang N. H.
• Format: Article
• Language: English
• Subjects: Computer architecture; Computer Imaging; Computer Science; Image compression; Image degradation; Image Processing and Computer Vision; Image quality; Image restoration; Learning; Multimedia Information Systems; Original Paper; Pattern Recognition and Graphics; Raindrops; Signal,Image and Speech Processing; Vision; Visual effects
• ISSN: 1863-1703; 1863-1711
• DOI: 10.1007/s11760-022-02262-8

Natural image degradation is frequently unavoidable for various reasons, including noise, blur, compression artifacts, haze, and raindrops. The majority of previous works have advanced significantly. They, however, consider only one type of degradation and overlook hybrid degradation factors, which are fairly common in natural images. To tackle this challenge, we propose a multistage network architecture. It is capable of gradually learning and restoring the hybrid degradation model of the image. The model comprises three stages, with each pair of adjacent stages combining to exchange information between the early and late stages. Meanwhile, we employ a double-pooling channel attention block that combines maximum and average pooling. It is capable of inferring more intricate channel attention and enhancing the network’s representation capability. Then, during the model training step, we introduce contrastive learning. Our method outperforms comparable methods in terms of qualitative scores and visual effects and restores more detailed textures to improve image quality.