Semantic Segmentation of Building Models with Deep Learning in CityGML

• Published in: International archives of the photogrammetry, remote sensing and spatial information sciences. remote sensing and spatial information sciences., 2024-01, Vol.XLVIII-4/W11-2024, p.97-102
• Main Authors: Rashidan, Hanis, Musliman, Ivin Amri, Abdul Rahman, Alias, Coors, Volker, Buyuksalih, Gurcan
• Format: Article
• Language: English
• Subjects: Architecture; Building components; Deep learning; Format; Labels; Performance measurement; Semantic segmentation; Semantics; Urban environments; Urban planning
• ISSN: 2194-9034; 1682-1750; 2194-9034
• DOI: 10.5194/isprs-archives-XLVIII-4-W11-2024-97-2024

Semantic segmentation of 3D urban environments plays an important role in urban planning, management, and analysis. This paper presents an exploration of leveraging BuildingGNN, a deep learning framework for semantic segmentation of 3D building models, and the subsequent conversion of semantic labels into CityGML, the standardized format for 3D city models. The study begins with a methodology outlining the acquisition of a labelled dataset from BuildingNet and the necessary preprocessing steps for compatibility with BuildingGNN's architecture. The training process involves deep learning techniques tailored for 3D building structures, yielding insights into model performance metrics such as Intersection over Union (IoU) for several architectural components. Evaluation of the trained model highlights its accuracy and reliability, albeit with challenges observed, particularly in segmenting certain classes like doors. Moreover, the conversion of semantic labels into CityGML format is discussed, emphasizing the importance of data quality and meticulous annotation practices. The experiment as described in the methodology shows that outputs from the BuildingGNN for semantic segmentation can be utilized for the generation of CityGML building elements with some percentage of success. This particular work reveals several challenges such as the identification of individual architectural elements based on geometry groups. We believe that the improvement of the segmentation process could be further investigated in our near future work.