AUC-based Combination of Dichotomizers: Is Whole Maximization also Effective for Partial Maximization?

• Main Authors: Ricamato, Maria Teresa, Tortorella, Francesco
• Format: Conference Proceeding
• Language: English
• Subjects: Accuracy; Algorithm design and analysis; Area under the ROC Curve; Combination of Classifiers; Indexes; Machine learning; Machine learning algorithms; Manganese; Optimized production technology
• ISSN: 1051-4651; 2831-7475
• DOI: 10.1109/ICPR.2010.27

The combination of classifiers is an established technique to improve the classification performance. When dealing with two-class classification problems, a frequently used performance measure is the Area under the ROC curve (AUC) since it is more effective than accuracy. However, in many applications, like medical or biometric ones, tests with false positive rate over a given value are of no practical use and thus irrelevant for evaluating the performance of the system. In these cases, the performance should be measured by looking only at the interesting part of the ROC curve. Consequently, the optimization goal is to maximize only a part of the AUC instead of the whole area. In this paper we propose a method tailored for these situations which builds a linear combination of two dichotomizers maximizing the partial AUC (pAUC). Another aim of the paper is to understand if methods that maximize the AUC can maximize also the pAUC. An empirical comparison drawn between algorithms maximizing the AUC and the proposed method shows that this latter is more effective for the pAUC maximization than methods designed to globally optimize the AUC.