Data dependency in multiple classifier systems

• Published in: Pattern recognition 2009-07, Vol.42 (7), p.1260-1273
• Main Authors: Dara, Rozita A., Kamel, Mohamed S., Wanas, Nayer
• Format: Article
• Language: English
• Subjects: Aggregation methods; Applied sciences; Class imbalance; Data dependency; Exact sciences and technology; Information, signal and communications theory; Multiple classifier systems; Signal and communications theory; Signal representation. Spectral analysis; Signal, noise; Stability; Telecommunications and information theory
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2008.11.035

In this paper, the data dependency of aggregation modules in multiple classifier system is being investigated. We first propose a new categorization scheme, in which combining methods are grouped into data-independent, implicitly data-dependent and explicitly data-dependent. It is argued that data-dependent approaches present the highest potential for improved performance. In this study, we intend to provide a comprehensive investigation of this argument and explore the impact of data dependency on the performance of multiple classifiers. We evaluate this impact based on two criteria, prediction accuracy and stability. In addition, we examine the effect of class imbalance and uneven data distribution on these two criteria. This paper presents the findings of an extensive set of comparative experiments. Based on the findings, it can be concluded that data-dependent aggregation methods are generally more stable and less sensitive to class imbalance. In addition, data-dependent methods exhibited superior or identical generalization ability for most of the data sets.