Mining High-Quality Pseudoinstance Soft Labels for Weakly Supervised Object Detection in Remote Sensing Images

Weakly supervised object detection in remote sensing images (RSI) is still a challenge because of the lack of instance-level labels, and many existing methods have two problems. First, most of the existing methods usually mine the pseudoground-truth (PGT) instances solely relying on proposal class s...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on geoscience and remote sensing 2023, Vol.61, p.1-15
Main Authors: Qian, Xiaoliang, Huo, Yu, Cheng, Gong, Gao, Chenyang, Yao, Xiwen, Wang, Wei
Format: Article
Language:English
Subjects:
Ablation
Benchmarks
Detection
Image segmentation
Labels
Methods
Object recognition
Probability theory
Remote sensing
Semantic segmentation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Weakly supervised object detection in remote sensing images (RSI) is still a challenge because of the lack of instance-level labels, and many existing methods have two problems. First, most of the existing methods usually mine the pseudoground-truth (PGT) instances solely relying on proposal class scores (PCSs). Actually, the reliability of PCS is not enough because of the bird’s eye view imaging and large-scale chaotic background of RSIs, and the instances with high PCS incline to cover the discriminative region, rather than the whole object. Second, the existing methods assign a one-hot label to each instance, and the label of the PGT instance is copied to its neighbor instances, which induces the misclassification problem to some extent. Actually, the probability that the neighbor instances contain the object with the same category is smaller than the PGT instance. For the first problem, the proposal quality score (PQS) is proposed for mining high-quality PGT instances, which contain PCS and dual-context projection score (DCPS). The DCPS is calculated through semantic segmentation and is employed to measure the completeness that each proposal covers an object. For the second problem, a pseudosoft label assignment (PSLA) strategy is proposed to assign a more precise soft label for each instance, where the soft label is determined by the spatial distance between each instance and its nearest PGT instance. The ablation study validates the effectiveness of the PQS and PSLA. The comprehensive comparisons with other WSOD methods on three popular benchmarks show the excellent performance of our method.
ISSN:0196-2892
1558-0644
DOI:10.1109/TGRS.2023.3266838