BOMSC-Net: Boundary Optimization and Multi-Scale Context Awareness Based Building Extraction From High-Resolution Remote Sensing Imagery

• Published in: IEEE transactions on geoscience and remote sensing 2022, Vol.60, p.1-17
• Main Authors: Zhou, Yuan, Chen, Zhanlong, Wang, Bin, Li, Shuangjiang, Liu, Hao, Xu, Daozhu, Ma, Chao
• Format: Article
• Language: English
• Subjects: Boundary optimization; Bridges; building extraction; Buildings; Coders; Context; Convolution; Data mining; Datasets; Decoding; Direction; direction field (DF); Discontinuity; Feature extraction; graph reasoning block (GRB); High resolution; Image resolution; Image segmentation; Imagery; Land management; Land use; Land use management; Methods; Modules; multi-scale context-aware module (MSCAM); Optimization; Qualitative analysis; Remote sensing; Resolution; Roofing materials; Semantics; Shadows; Urban planning
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2022.3152575

Automatic building extraction from high-resolution remote sensing imagery has various applications, such as urban planning and land use management. However, the existing methods for automatic building extraction focus on regional accuracy but not on boundary quality. As a result, these building extraction methods yield discontinuous results due to tree and shadow occlusions and complex building roof materials. In this article, BOMSC-Net, which can consider boundary optimization and multi-scale context awareness, is proposed to address these two problems. BOMSC-Net is an encoder-to-decoder network composed of a basic network, a multi-scale context-aware module (MSCAM), and a direction feature optimization module (DFOM). The basic network learns to predict building segmentation maps through attention gates (AGs) that connect low-level feature jumps to advanced semantics. MSCAM is used as a bridge, which uses graph reasoning blocks (GRBs) to solve intra-class discontinuities. Finally, the DFOM constructs a direction field (DF) and then uses direction information for boundary correction to achieve fine building segmentations. Experiments were conducted on the open Massachusetts building dataset, WHU aerial building dataset, and Inria aerial image labeling dataset. The quantitative and qualitative analyses demonstrate that the proposed BOMSC-Net can help building extraction overcome interruptions caused by shadows and occlusions, extract buildings with different scales and materials, and realize boundary optimization and complete segmentation of buildings.