Evolutionary extreme learning machine with sparse cost matrix for imbalanced learning

• Published in: ISA transactions 2020-05, Vol.100, p.198-209
• Main Authors: Li, Hui, Yang, Xi, Li, Yang, Hao, Li-Ying, Zhang, Tian-Lun
• Format: Article
• Language: English
• Subjects: Cost matrix; Error bound model; Evolutionary algorithm; Extreme learning machine; Imbalanced learning
• ISSN: 0019-0578; 1879-2022
• DOI: 10.1016/j.isatra.2019.11.020

Extreme learning machine is a popular machine learning technique for single hidden layer feed-forward neural network. However, due to the assumption of equal misclassification cost, the conventional extreme learning machine fails to properly learn the characteristics of the data with skewed category distribution. In this paper, to enhance the representation of few-shot cases, we break down that assumption by assigning penalty factors to different classes, and minimizing the cumulative classification cost. To this end, a case-weighting extreme learning machine is developed on a sparse cost matrix with a diagonal form. To be more actionable, we formulate a multi-objective optimization with respect to penalty factors, and optimize this problem using an evolutionary algorithm combined with an error bound model. By doing so, this proposed method is developed into an adaptive cost-sensitive learning, which is guided by the relation between the generalization ability and the case-weighting factors. In a broad experimental study, our method achieves competitive results on benchmark and real-world datasets for software bug reports identification. •A new imbalanced learning.•Adaptive cost-sensitive learning.•Error bound model for fitness function.•Deriving the relation between the generalization ability and the weighting factors.•Good performance on imbalanced issues.