Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

Contrastive learning has emerged as a promising technique for hyperspectral image (HSI) classification. However, the inherent limitation of sliding window sampling in HSI results in partial samples within a mini-batch exhibiting extremely high similarity. Consequently, there is an increased number o...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on geoscience and remote sensing 2024, Vol.62, p.1-14
Main Authors: Zhao, Lin, Li, Jia, Luo, Wenqiang, Ouyang, Er, Wu, Jianhui, Zhang, Guoyun, Li, Wujin
Format: Article
Language:English
Subjects:
Artificial neural networks
Classification
Computer architecture
Contrastive learning
Convolution
convolutional neural network (CNN)
Convolutional neural networks
Data mining
Feature extraction
hyperspectral image (HSI) classification
Hyperspectral imaging
Image classification
Learning
Neural networks
Representations
Task analysis
Transformers
vision Transformer
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Contrastive learning has emerged as a promising technique for hyperspectral image (HSI) classification. However, the inherent limitation of sliding window sampling in HSI results in partial samples within a mini-batch exhibiting extremely high similarity. Consequently, there is an increased number of negative sample pairs composed of similar samples, significantly reducing the effectiveness of contrastive learning. Moreover, prevailing classification models heavily depends on convolutional operations, emphasizing the extraction of local features but struggle to capture long-distance dependencies in both spatial and spectral dimensions. To address these problems and fully leverage the abundance of unlabeled samples, we propose a novel purified contrastive learning (PCL) framework for HSI classification. We design a complementary spatial-spectral representation encoder architecture that combines convolutional neural network (CNN) and Transformer to capture local features and global dependencies. More importantly, a purified contrastive loss function is proposed based on super-pixel spatial prior. Extensive experiments on three public datasets demonstrate the superiority of PCL over state-of-the-art methods in HSI classification. The code for this work is available at https://github.com/zhaolin6/PCL for the sake of reproducibility.
ISSN:0196-2892
1558-0644
DOI:10.1109/TGRS.2024.3409378