Ensembles of jittered association rule classifiers

• Published in: Data mining and knowledge discovery 2010-07, Vol.21 (1), p.91-129
• Main Authors: Azevedo, Paulo J., Jorge, Alípio Mário
• Format: Article
• Language: English
• Subjects: Accuracy; Artificial Intelligence; Bias; Chemistry and Earth Sciences; Classification; Classifiers; Computational efficiency; Computer Science; Data Mining and Knowledge Discovery; Datasets; Error analysis; Information Storage and Retrieval; Learning; Mathematical models; Physics; Statistics for Engineering; Strategy
• ISSN: 1384-5810; 1573-756X
• DOI: 10.1007/s10618-010-0173-y

The ensembling of classifiers tends to improve predictive accuracy. To obtain an ensemble with N classifiers, one typically needs to run N learning processes. In this paper we introduce and explore Model Jittering Ensembling, where one single model is perturbed in order to obtain variants that can be used as an ensemble. We use as base classifiers sets of classification association rules. The two methods of jittering ensembling we propose are Iterative Reordering Ensembling (IRE) and Post Bagging (PB). Both methods start by learning one rule set over a single run, and then produce multiple rule sets without relearning. Empirical results on 36 data sets are positive and show that both strategies tend to reduce error with respect to the single model association rule classifier. A bias–variance analysis reveals that while both IRE and PB are able to reduce the variance component of the error, IRE is particularly effective in reducing the bias component. We show that Model Jittering Ensembling can represent a very good speed-up w.r.t. multiple model learning ensembling. We also compare Model Jittering with various state of the art classifiers in terms of predictive accuracy and computational efficiency.