Blind cloud and cloud shadow removal of multitemporal images based on total variation regularized low-rank sparsity decomposition

• Published in: ISPRS journal of photogrammetry and remote sensing 2019-11, Vol.157, p.93-107
• Main Authors: Chen, Yong, He, Wei, Yokoya, Naoto, Huang, Ting-Zhu
• Format: Article
• Language: English
• Subjects: Alternating direction method of multipliers; Cloud/shadow removal; Low-rank and sparsity; Multitemporal images; Total variation
• ISSN: 0924-2716; 1872-8235
• DOI: 10.1016/j.isprsjprs.2019.09.003

Cloud and cloud shadow (cloud/shadow) removal from multitemporal satellite images is a challenging task and has elicited much attention for subsequent information extraction. Regarding cloud/shadow areas as missing information, low-rank matrix/tensor completion based methods are popular to recover information undergoing cloud/shadow degradation. However, existing methods required to determine the cloud/shadow locations in advance and failed to completely use the latent information in cloud/shadow areas. In this study, we propose a blind cloud/shadow removal method for time-series remote sensing images by unifying cloud/shadow detection and removal together. First, we decompose the degraded image into low-rank clean image (surface-reflected) component and sparse (cloud/shadow) component, which can simultaneously and completely use the underlying characteristics of these two components. Meanwhile, the spatial-spectral total variation regularization is introduced to promote the spatial-spectral continuity of the cloud/shadow component. Second, the cloud/shadow locations are detected from the sparse component using a threshold method. Finally, we adopt the cloud/shadow detection results to guide the information compensation from the original observed images to better preserve the information in cloud/shadow-free locations. The problem of the proposed model is efficiently addressed using the alternating direction method of multipliers. Both simulated and real datasets are performed to demonstrate the effectiveness of our method for cloud/shadow detection and removal when compared with other state-of-the-art methods.