Multilevel Feature Aggregated Network with Instance Contrastive Learning Constraint for Building Extraction

• Published in: Remote sensing (Basel, Switzerland) Switzerland), 2023-05, Vol.15 (10), p.2585
• Main Authors: Li, Shiming, Bao, Tingrui, Liu, Hui, Deng, Rongxin, Zhang, Hui
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; building extraction; Buildings; Coders; contrastive learning; Deep learning; Disaster management; Emergency preparedness; Emergency response; feature aggregation; Neural networks; Remote sensing; remote sensing image; semantic segmentation; Semantics
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs15102585

Building footprint extraction from remotely sensed imagery is a critical task in the field of illegal building discovery, urban dynamic monitoring, and disaster emergency response. Recent research has made significant progress in this area by utilizing deep learning techniques. However, it remains difficult to efficiently balance the spatial detail and rich semantic features. In particular, the extracted building edge is often inaccurate, especially in areas where the buildings are densely distributed, and the boundary of adjacent building instances is difficult to distinguish accurately. Additionally, identifying buildings with varying scales remains a challenging problem. To address the above problems, we designed a novel framework that aggregated multilevel contextual information extracted from multiple encoders. Furthermore, we introduced an instance constraint into contrastive learning to enhance the robustness of the feature representation. Experimental results demonstrated that our proposed method achieved 91.07% and 74.58% on the intersection over union metric on the WHU and Massachusetts datasets, respectively, outperforming the most recent related methods. Notably, our method significantly improved the accuracy of building boundaries, especially at the building instance level, and the integrity of multi-scale buildings.