A Triplet Nonlocal Neural Network With Dual-Anchor Triplet Loss for High-Resolution Remote Sensing Image Retrieval

Conventional deep-learning-based retrieval models are generally trained under the framework of scene classification with cross-entropy loss, this way focuses only on the output probability corresponding to the label of input samples, while ignoring the predictive information of other categories, whi...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of selected topics in applied earth observations and remote sensing 2021, Vol.14, p.2711-2723
Main Authors: Zhang, Maoding, Cheng, Qimin, Luo, Fang, Ye, Lan
Format: Article
Language:English
Subjects:
Algorithms
Convolution
Datasets
Deep metric learning (DML)
dual-anchor triplet loss
Entropy
Entropy (Information theory)
Feature extraction
High resolution
high-resolution remote sensing image (HRRSI) retrieval
Image management
Image resolution
Image retrieval
Information processing
Kernel
Machine learning
Neural networks
Probability theory
Remote sensing
Resolution
Task analysis
Training
triplet nonlocal neural network (T-NLNN)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Conventional deep-learning-based retrieval models are generally trained under the framework of scene classification with cross-entropy loss, this way focuses only on the output probability corresponding to the label of input samples, while ignoring the predictive information of other categories, which makes the retrieval accuracy susceptible to the intraclass difference of the image samples. And conventional methods often used fixed-size convolution kernels that only consider the local area with fixed sizes, thus largely ignoring the global information. In response to the above problems, this article constructs a triplet nonlocal neural network (T-NLNN) model that combines deep metric learning and nonlocal operation. The proposed T-NLNN follows the three-branch network design, with shared weights in each branch. We evaluate T-NLNN on three public high-resolution remote sensing datasets, and the experimental results suggest that T-NLNN has discriminative feature learning ability and outperforms other existing algorithms. In addition, we propose a dual-anchor triplet loss function to facilitate the utilization of information in the input samples. The experimental results prove that the proposed dual-anchor triplet loss function works better than the traditional triplet loss function on all datasets.
ISSN:1939-1404
2151-1535
DOI:10.1109/JSTARS.2021.3058691