CloudFU-Net: A Fine-Grained Segmentation Method for Ground-Based Cloud Images Based on an Improved Encoder-Decoder Structure

• Published in: IEEE transactions on geoscience and remote sensing 2024, Vol.62, p.1-13
• Main Authors: Shi, Chaojun, Su, Zibo, Zhang, Ke, Xie, Xiongbin, Zheng, Xian, Lu, Qiaochu, Yang, Jiyuan
• Format: Article
• Language: English
• Subjects: Cloud computing; Clouds; Coders; Decoding; Dilated convolution; fine-grained segmentation of ground-based cloud; ground-based cloud image dataset; Ground-based observation; Image processing; Image segmentation; Irradiance; Kitchenware; Meteorologists; photovoltaic power prediction; Photovoltaic systems; Photovoltaics; Predictions; selective kernel (SK) attention; Semantics; Solar irradiance; Solar radiation; Weather forecasting
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2024.3389089

The segmentation of ground-based cloud image is a crucial aspect of ground-based cloud observation, with significant implications for meteorological forecasting, photovoltaic power prediction, and other related tasks. At present, the proposed method of ground-based cloud image segmentation only separates cloud from the sky background without further classifying the cloud categories. Clouds have rich fine-grained semantic features, and different types of clouds have different effects on solar irradiance, which in turn has different effects on photovoltaic power. In this article, a fine-grained segmentation method for ground-based cloud images is proposed, which is based on an improved encoder-decoder structure named CloudFU-Net. First, a ground-based cloud image fine-grained segmentation dataset for photovoltaic power prediction is constructed, and the clouds are divided into five categories with different colors under the guidance of meteorologists. Second, selective kernel (SK) is introduced in the CloudFU-Net encoder to better capture cloud of different sizes. Then, a parallel dilated convolution model (PDCM) is proposed to segment small target clouds more accurately. Finally, a content-aware reassembly of features (CARAFE) is introduced into the CloudFU-Net decoder to replace the original interpolating upsampling to better recover fine-grained semantic features. Finally, the experimental results show that the proposed CloudFU-Net has the best segmentation performance compared with other segmentation models, with Miou reaching 61.9%, which can efficiently segment different cloud genera and lay a solid foundation for accurate prediction of photovoltaic power.