Water extraction from optical high-resolution remote sensing imagery: a multi-scale feature extraction network with contrastive learning

• Published in: GIScience and remote sensing 2023-12, Vol.60 (1)
• Main Authors: Liu, Bo, Du, Shihong, Bai, Lubin, Ouyang, Song, Wang, Haoyu, Zhang, Xiuyuan
• Format: Article
• Language: English
• Subjects: contrastive learning; high-resolution remote sensing images; multi-scale features; Water extraction
• ISSN: 1548-1603; 1943-7226
• DOI: 10.1080/15481603.2023.2166396

Accurately spatiotemporal distribution of water bodies is of great importance in the fields of ecology and environment. Recently, convolutional neural networks (CNN) have been widely used for this purpose due to their powerful features extraction ability. However, the CNN methods have two limitations in extracting water bodies. First, the large variations in both the spatial and spectral characteristics of water bodies require that the CNN-based methods have the ability of extracting multi-scale features and using multi-layer features. Second, collecting enough samples is a difficult problem in the training phase of CNN. Therefore, this paper proposed a multi-scale features extraction network (MSFENet) for water extraction, and its advantages are contributed to two distinct features: (1) scale features extractor (MSFE) is designed to extract multi-layer multi-scale features of water bodies; (2) contrastive learning (CL) is adopted to reduce the sample size requirement. Experimental results show that MSFE can effectively improve the small water body extraction performance, and the CL can significantly improve the extraction accuracy when the training sample size is small. Compared with other methods, MSFENet achieves the highest F1-score and kappa coefficient in two datasets. Furthermore, spectral variability analysis shows that MSFENet is more robust than other neural networks in a spectrum variation scenario.