Evolutionary extreme learning machine ensembles with size control

Ensemble learning aims to improve the generalization power and the reliability of learner models through sampling and optimization techniques. It has been shown that an ensemble constructed by a selective collection of base learners outperforms favorably. However, effective implementation of such an...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2013-02, Vol.102, p.98-110
Main Authors: Wang, Dianhui, Alhamdoosh, Monther
Format: Article
Language:English
Subjects:
Algorithmics. Computability. Computer arithmetics
Applied sciences
Artificial intelligence
Computer science
control theory
systems
Computer simulation
Connectionism. Neural networks
Data processing. List processing. Character string processing
Elm
Evolutionary
Evolutionary computation
Exact sciences and technology
Extreme learning machines
Generalization capability
Learner model ensembles
Learning
Mathematical models
Memory organisation. Data processing
Neural networks
Optimization
Regression
Robustness
Software
Theoretical computing
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Ensemble learning aims to improve the generalization power and the reliability of learner models through sampling and optimization techniques. It has been shown that an ensemble constructed by a selective collection of base learners outperforms favorably. However, effective implementation of such an ensemble from a given learner pool is still an open problem. This paper presents an evolutionary approach for constituting extreme learning machine (ELM) ensembles. Our proposed algorithm employs the model diversity as fitness function to direct the selection of base learners, and produces an optimal solution with ensemble size control. A comprehensive comparison is carried out, where the basic ELM is used to generate a set of neural networks and 12 benchmarked regression datasets are employed in simulations. Our reporting results demonstrate that the proposed method outperforms other ensembling techniques, including simple average, bagging and adaboost, in terms of both effectiveness and efficiency.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2011.12.046