ESDSCNet: an enhanced shallow feature difference and semantic context network for remote sensing change detection: with building change detection as a case

• Published in: International journal of remote sensing 2023-06, Vol.44 (12), p.3726-3752
• Main Authors: Du, Tongyao, Ming, Dongping, Gu, Haiyan, Fang, Kun, Xu, Lu, Dong, Dehui, Zhang, Yu, Liu, Luheng
• Format: Article
• Language: English
• Subjects: Aggregation; bi-temporal images; building change detection; Change detection; change object contextual representations; Context; Deep learning; Detection; difference statistical texture learning; fully convolutional Siamese network; Modules; Remote sensing; Semantics
• ISSN: 0143-1161; 1366-5901
• DOI: 10.1080/01431161.2023.2225712

Change detection (CD) is a challenging task considering land surface cover changes. Recently, deep learning has been introduced into CD. However, these methods suffer from shortcomings such as insufficient utilization of shallow features and inadequate aggregation of semantic context, which result in pseudo changes and poor integrity of change objects. To address this, an enhanced shallow feature difference and semantic context network (ESDSCNet) is proposed in this study for remote sensing CD. It uses HRNet to extract multi-scale features from bi-temporal images to obtain shallow and deep features. To fully exploit the shallow features, they are input into the difference statistical texture learning (DSTL) module to extract more discriminative features. Subsequently, the features enhanced by DSTL are fed into the change object contextual representation (COCR) module along with the deep difference features extracted by HRNet to characterize the contextual information of the change object. To verify the performance of ESDSCNet in different scenes, this paper takes building change detection as a case and conducts experiments based on three datasets. The experimental results reveal that ESDSCNet outperforms six other advanced methods, regardless of the intersection over union or the harmonic mean of precision rate and recall rate, which further confirms the effectiveness of the proposed network. In addition, another speciality of this paper is that ESDSCNet can identify not only 'Where has changed' but also 'What has changed what', so it has potential application in semantic change detection besides building change detection.