Ensemble synthetic oversampling with pixel pair for class-imbalanced and small-sized hyperspectral data classification

• Published in: International journal of applied earth observation and geoinformation 2024-04, Vol.128, p.103697, Article 103697
• Main Authors: Feng, Wei, Long, Yijun, Dauphin, Gabriel, Quan, Yinghui, Huang, Wenjiang, Xing, Mengdao
• Format: Article
• Language: English
• Subjects: Ensemble learning; Hyperspectral image classification; Imbalanced data; Small-sized data
• ISSN: 1569-8432; 1872-826X
• DOI: 10.1016/j.jag.2024.103697

Hyperspectral images (HSI) suffer from limited labeled data and the curse of dimensionality, which makes it difficult to classify imbalanced and small-sized HSI data. To address the mentioned issues, pixel pair features is designed to handle small-size problem. However, the augmented data inherits the class imbalance and even exhibits a larger imbalance ratio. Therefore, the ensemble-based Synthetic Minority Oversampling Technique (SMOTE) is integrated into pixel pair features to deal with imbalanced datasets and strengthen the quality of the augmented datasets. The proposed method is evaluated on five groups of HSI datasets and compared against seven state-of-the-art contrast algorithms, including ensemble-CNN (E-CNN), CNN with pixel pair features, ensemble CNN with pixel pair features, spatial–spectral E-ResNet, E-Transfering-VGGNet, ContextualNet, and CNN with K-means SMOTE. The proposed method demonstrates superior performance across three distinct difficulty levels, as determined by its average performance rank on five HSI datasets. This underscores its effectiveness in mitigating small size and class imbalance challenges. •Effective method for imbalanced and small-sized hyperspectral data.•Synergy of ensemble synthetic oversampling and pixel pair.•Three distinct difficulty case studies on each of five datasets prove effectiveness.