A survey on data preprocessing for data stream mining: Current status and future directions

• Published in: Neurocomputing (Amsterdam) 2017-05, Vol.239, p.39-57
• Main Authors: Ramírez-Gallego, Sergio, Krawczyk, Bartosz, García, Salvador, Woźniak, Michał, Herrera, Francisco
• Format: Article
• Language: English
• Subjects: Concept drift; Data discretization; Data mining; Data preprocessing; Data reduction; Data stream; Feature selection; Instance selection; Online learning
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2017.01.078

Data preprocessing and reduction have become essential techniques in current knowledge discovery scenarios, dominated by increasingly large datasets. These methods aim at reducing the complexity inherent to real-world datasets, so that they can be easily processed by current data mining solutions. Advantages of such approaches include, among others, a faster and more precise learning process, and more understandable structure of raw data. However, in the context of data preprocessing techniques for data streams have a long road ahead of them, despite online learning is growing in importance thanks to the development of Internet and technologies for massive data collection. Throughout this survey, we summarize, categorize and analyze those contributions on data preprocessing that cope with streaming data. This work also takes into account the existing relationships between the different families of methods (feature and instance selection, and discretization). To enrich our study, we conduct thorough experiments using the most relevant contributions and present an analysis of their predictive performance, reduction rates, computational time, and memory usage. Finally, we offer general advices about existing data stream preprocessing algorithms, as well as discuss emerging future challenges to be faced in the domain of data stream preprocessing.