A novel online ensemble approach to handle concept drifting data streams: diversified dynamic weighted majority

We present an online ensemble approach, diversified dynamic weighted majority (DDWM) to classify new data instances which have varying conceptual distributions. Our approach maintains two sets of weighted ensembles that differentiate in their level of diversity. An expert in either of the ensembles...

Full description

Saved in:
Bibliographic Details
Published in:International journal of machine learning and cybernetics 2018, Vol.9 (1), p.37-61
Main Authors: Sidhu, Parneeta, Bhatia, M. P. S.
Format: Article
Language:English
Subjects:
Accuracy
Algorithms
Artificial Intelligence
Business metrics
Classification
Complex Systems
Computational Intelligence
Control
Data transmission
Datasets
Engineering
Mechatronics
Original Article
Pattern Recognition
Performance measurement
Robotics
Systems Biology
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present an online ensemble approach, diversified dynamic weighted majority (DDWM) to classify new data instances which have varying conceptual distributions. Our approach maintains two sets of weighted ensembles that differentiate in their level of diversity. An expert in either of the ensembles is updated or removed as per its classification accuracy and a new expert is added based on the final global prediction of the algorithm and the global prediction of the ensemble for any data instance. Experimental evaluation using various artificial and real-world datasets proves that DDWM provides very high accuracy in classifying new data instances, irrespective of size of dataset, type of drift or presence of noise. We compare DDWM with the other learners in terms of new performance metrics such as kappa statistic, model cost, and the evaluation time and memory requirements. Our approach proved to be highly resource effective achieving very high accuracies even in a resource constrained environment.
ISSN:1868-8071
1868-808X
DOI:10.1007/s13042-015-0333-x