Understanding rooftop PV panel semantic segmentation of satellite and aerial images for better using machine learning

• Published in: Advances in applied energy 2021-11, Vol.4, p.100057, Article 100057
• Main Authors: Li, Peiran, Zhang, Haoran, Guo, Zhiling, Lyu, Suxing, Chen, Jinyu, Li, Wenjing, Song, Xuan, Shibasaki, Ryosuke, Yan, Jinyue
• Format: Article
• Language: English
• Subjects: Computer vision; Deep learning; PV Computer vision Deep learning Satellite and aerial image Semantic segmentation; Satellite and aerial image; Semantic segmentation
• ISSN: 2666-7924; 2666-7924
• DOI: 10.1016/j.adapen.2021.100057

lRevealing highly class-imbalance and non-concentrated distribution of PV panel image data.lFinding the notable resolution threshold for effective PV panel semantic-segmentation.lExploring homogeneous texture feature and heterogenous color feature of PV panel image data.lProviding recommendations on further improvements of PV panel semantic-segmentation. The photovoltaic (PV) industry boom and increased PV applications call for better planning based on accurate and updated data on the installed capacity. Compared with the manual statistical approach, which is often time-consuming and labor-intensive, using satellite/aerial images to estimate the existing PV installed capacity offers a new method with cost-effective and data-consistent features. Previous studies investigated the feasibility of segmenting PV panels from images involving machine learning technologies. However, due to the particular characteristics of PV panel semantic-segmentation, the machine learning tools need to be designed and applied with careful considerations of the issue formulation, data quality, and model explainability. This paper investigated the characteristics of PV panel semantic-segmentation from the perspective of computer vision. The results reveal that the PV panel image data has several specific characteristics: highly class-imbalance and non-concentrated distribution; homogeneous texture and heterogenous color features; and the notable resolution threshold for effective semantic-segmentation. Moreover, this paper provided recommendations for data obtaining and model design, aiming at each observed character from the viewpoints of recent solutions in computer vision, which can be helpful for future improvement of the PV panel semantic-segmentation.