Detecting Fine-Grained Airplanes in SAR Images With Sparse Attention-Guided Pyramid and Class-Balanced Data Augmentation

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing 2022, Vol.15, p.8586-8599
• Main Authors: Bao, Wei, Hu, Jingjing, Huang, Meiyu, Xu, Yao, Ji, Nan, Xiang, Xueshuang
• Format: Article
• Language: English
• Subjects: Aircraft; Airplanes; Benchmarks; Class-balanced copy-paste data augmentation (CC-DA); Data augmentation; Deep learning; Detection; Detectors; Feature extraction; fine-grained airplane detection; large intraclass variance; Methods; Object detection; Pastes; Probability theory; Radar detection; Radar imaging; Radar polarimetry; SAR (radar); small interclass variance; sparse attention-guided fine-grained pyramid; Synthetic aperture radar; Variance
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2022.3208928

Airplane detection in synthetic aperture radar (SAR) images has drawn much attention owing to the success of deep learning methods. However, the development of fine-grained airplane detection in SAR images is still in a dilemma due to the small interclass variance and the large intraclass variance in complex scenes with strong interference from the background. In addition, the class imbalance problem in multiclass fine-grained airplane recognition also significantly limits the direct application of general deep-learning-based airplane detectors. This article proposes two effective methods to tackle the above two problems, respectively. First, we propose a sparse attention-guided fine-grained pyramid module to simultaneously sample discriminative local features scattered in multiscale layers and adaptively aggregate them with fine-grained attention to better classify subordinate-level airplanes with multiple scales. Second, a simple class-balanced copy-paste data augmentation strategy, which randomly copies an airplane of one category and pastes it onto an image according to the classwise probability, is proposed for class balance. Finally, extensive experiments on one public dataset and three representative deep-learning-based detection benchmarks are conducted to show the effectiveness and generalization of the two proposed methods. The combination of these two methods based on the cascade R-CNN benchmark also won the fifth place in fine-grained airplane detection in SAR images in the 2021 GaoFen Challenge.