An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics

• Published in: Information sciences 2013-11, Vol.250, p.113-141
• Main Authors: López, Victoria, Fernández, Alberto, García, Salvador, Palade, Vasile, Herrera, Francisco
• Format: Article
• Language: English
• Subjects: Cost-sensitive learning; Dataset shift; Imbalanced dataset; Noisy data; Sampling; Small disjuncts
• ISSN: 0020-0255; 1872-6291
• DOI: 10.1016/j.ins.2013.07.007

Training classifiers with datasets which suffer of imbalanced class distributions is an important problem in data mining. This issue occurs when the number of examples representing the class of interest is much lower than the ones of the other classes. Its presence in many real-world applications has brought along a growth of attention from researchers. We shortly review the many issues in machine learning and applications of this problem, by introducing the characteristics of the imbalanced dataset scenario in classification, presenting the specific metrics for evaluating performance in class imbalanced learning and enumerating the proposed solutions. In particular, we will describe preprocessing, cost-sensitive learning and ensemble techniques, carrying out an experimental study to contrast these approaches in an intra and inter-family comparison. We will carry out a thorough discussion on the main issues related to using data intrinsic characteristics in this classification problem. This will help to improve the current models with respect to: the presence of small disjuncts, the lack of density in the training data, the overlapping between classes, the identification of noisy data, the significance of the borderline instances, and the dataset shift between the training and the test distributions. Finally, we introduce several approaches and recommendations to address these problems in conjunction with imbalanced data, and we will show some experimental examples on the behavior of the learning algorithms on data with such intrinsic characteristics.