Image rain removal and illumination enhancement done in one go

Rain removal plays an important role in the restoration of degraded images. Recently, CNN-based methods have achieved remarkable success. However, these approaches neglect that the appearance of real-world rain is often accompanied by low light conditions, which will further degrade the image qualit...

Full description

Saved in:
Bibliographic Details
Published in:Knowledge-based systems 2022-09, Vol.252, p.109244, Article 109244
Main Authors: Wan, Yecong, Cheng, Yuanshuo, Shao, Mingwen, Gonzàlez, Jordi
Format: Article
Language:English
Subjects:
Contrastive learning
Low-light image enhancement
Rain removal
Spatially-adaptive network
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Rain removal plays an important role in the restoration of degraded images. Recently, CNN-based methods have achieved remarkable success. However, these approaches neglect that the appearance of real-world rain is often accompanied by low light conditions, which will further degrade the image quality, thereby hindering the restoration mission. Therefore, it is very indispensable to jointly remove the rain and enhance illumination for real-world rain image restoration. To this end, we proposed a novel spatially-adaptive network, dubbed SANet, which can remove the rain and enhance illumination in one go with the guidance of degradation mask. Meanwhile, to fully utilize negative samples, a contrastive loss is proposed to preserve more natural textures and consistent illumination. In addition, we present a new synthetic dataset, named DarkRain, to boost the development of rain image restoration algorithms in practical scenarios. DarkRain not only contains different degrees of rain, but also considers different lighting conditions, and more realistically simulates real-world rainfall scenarios. SANet is extensively evaluated on the proposed dataset and attains new state-of-the-art performance against other combining methods. Moreover, after a simple transformation, our SANet surpasses existing the state-of-the-art algorithms in both rain removal and low-light image enhancement. •We propose a novel unified framework to simultaneously remove rain and enhance illumination.•A new synthetic dataset for rainy day image restoration is proposed.•Our SANet is extensively evaluated and attains new state-of-the-art performance.
ISSN:0950-7051
1872-7409
DOI:10.1016/j.knosys.2022.109244