RUSBoost: A Hybrid Approach to Alleviating Class Imbalance

• Published in: IEEE transactions on systems, man and cybernetics. Part A, Systems and humans man and cybernetics. Part A, Systems and humans, 2010-01, Vol.40 (1), p.185-197
• Main Authors: Seiffert, C., Khoshgoftaar, T.M., Van Hulse, J., Napolitano, A.
• Format: Article
• Language: English
• Subjects: Binary classification; Boosting; class imbalance; Computer science; Costs; Data mining; Humans; Performance evaluation; RUSBoost; sampling; Sampling methods; Training data
• ISSN: 1083-4427; 1558-2426
• DOI: 10.1109/TSMCA.2009.2029559

Class imbalance is a problem that is common to many application domains. When examples of one class in a training data set vastly outnumber examples of the other class(es), traditional data mining algorithms tend to create suboptimal classification models. Several techniques have been used to alleviate the problem of class imbalance, including data sampling and boosting. In this paper, we present a new hybrid sampling/boosting algorithm, called RUSBoost, for learning from skewed training data. This algorithm provides a simpler and faster alternative to SMOTEBoost, which is another algorithm that combines boosting and data sampling. This paper evaluates the performances of RUSBoost and SMOTEBoost, as well as their individual components (random undersampling, synthetic minority oversampling technique, and AdaBoost). We conduct experiments using 15 data sets from various application domains, four base learners, and four evaluation metrics. RUSBoost and SMOTEBoost both outperform the other procedures, and RUSBoost performs comparably to (and often better than) SMOTEBoost while being a simpler and faster technique. Given these experimental results, we highly recommend RUSBoost as an attractive alternative for improving the classification performance of learners built using imbalanced data.