Using structure-based data transformation method to improve prediction accuracies for small data sets

• Published in: Decision Support Systems 2012-02, Vol.52 (3), p.748-756
• Main Authors: Li, Der-Chiang, Chang, Chih-Chieh, Liu, Chiao-Wen
• Format: Article
• Language: English
• Subjects: Applied sciences; Artificial intelligence; Back propagation; Cluster; Clusters; Computer science; control theory; systems; Connectionism. Neural networks; Data processing. List processing. Character string processing; DBSCAN; Errors; Exact sciences and technology; Fuzzy logic; Linear inference, regression; Manufacturing; Mathematical analysis; Mathematical models; Mathematics; Memory organisation. Data processing; Neural networks; Optimization algorithms; Probability and statistics; Regression; Regression analysis; Sciences and techniques of general use; Small data set; Software; Statistics; Studies; SVR; Transformations
• ISSN: 0167-9236; 1873-5797
• DOI: 10.1016/j.dss.2011.11.021

Small data set problems have been widely considered in many fields, where increasing the prediction ability is the most important goal. This study considers the data structure to identify new data points in a more precise manner, and is thus able to achieve improved prediction capability. The proposed method, named structure-based data transformation, consists of two steps. The first step is using the density-based spatial clustering of applications with noise (DBSCAN) algorithm to separate data sets into clusters, which generates the number of clusters dynamically. The second step is to build up the data transformation function, in which the new attributes are computed using fuzzy membership functions obtained by the corresponding membership grades in each cluster. Three real cases are selected to compare the proposed forecasting model with the linear regression (LR), backpropagation neural network (BPNN), and support vector machine for regression (SVR) methods. The result show that the structure-based data transformation method has better performance than when using the raw data with regard to the error improving rate, mean square error (MSE), and standard deviation (STD). ► This study presents structure-based data transformation to achieve improved prediction capability for small data sets. ► Using a function kernel to extend the data set into a higher dimensional space. ► Three real cases show better performance by using the proposed method.