Online Ensemble Using Adaptive Windowing for Data Streams with Concept Drift

Data streams, which can be considered as one of the primary sources of what is called big data, arrive continuously with high speed. The biggest challenge in data streams mining is to deal with concept drifts, during which ensemble methods are widely employed. The ensembles for handling concept drif...

Full description

Saved in:
Bibliographic Details
Published in:International journal of distributed sensor networks 2016-01, Vol.2016 (5), p.4218973
Main Authors: Sun, Yange, Wang, Zhihai, Liu, Haiyang, Du, Chao, Yuan, Jidong
Format: Article
Language:English
Subjects:
Accuracy
Adaptive algorithms
Algorithms
Applied research
Big Data
Blocking
Consumption
Data mining
Data processing
Data transmission
Datasets
Drift
High speed
Information technology
Methods
Online
Studies
Tuning
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Data streams, which can be considered as one of the primary sources of what is called big data, arrive continuously with high speed. The biggest challenge in data streams mining is to deal with concept drifts, during which ensemble methods are widely employed. The ensembles for handling concept drift can be categorized into two different approaches: online and block-based approaches. The primary disadvantage of the block-based ensembles lies in the difficulty of tuning the block size to provide a tradeoff between fast reactions to drifts. Motivated by this challenge, we put forward an online ensemble paradigm, which aims to combine the best elements of block-based weighting and online processing. The algorithm uses the adaptive windowing as a change detector. Once a change is detected, a new classifier is built replacing the worst one in the ensemble. By experimental evaluations on both synthetic and real-world datasets, our method performs significantly better than other ensemble approaches.
ISSN:1550-1329
1550-1477
1550-1477
DOI:10.1155/2016/4218973