A Unifying Framework for Learning the Linear Combiners for Classifier Ensembles

For classifier ensembles, an effective combination method is to combine the outputs of each classifier using a linearly weighted combination rule. There are multiple ways to linearly combine classifier outputs and it is beneficial to analyze them as a whole. We present a unifying framework for multi...

Full description

Saved in:
Bibliographic Details
Main Authors: Erdogan, H, Sen, M U
Format: Conference Proceeding
Language:English
Subjects:
Accuracy
classifier fusion
Fasteners
linear classifier learning
linear combiners
Minimization
stacked generalization
Training
Training data
Vectors
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:For classifier ensembles, an effective combination method is to combine the outputs of each classifier using a linearly weighted combination rule. There are multiple ways to linearly combine classifier outputs and it is beneficial to analyze them as a whole. We present a unifying framework for multiple linear combination types in this paper. This unification enables using the same learning algorithms for different types of linear combiners. We present various ways to train the weights using regularized empirical loss minimization. We propose using the hinge loss for better performance as compared to the conventional least-squares loss. We analyze the effects of using hinge loss for various types of linear weight training by running experiments on three different databases. We show that, in certain problems, linear combiners with fewer parameters may perform as well as the ones with much larger number of parameters even in the presence of regularization.
ISSN:1051-4651
2831-7475
DOI:10.1109/ICPR.2010.731