Research on missing value estimation in data mining

Data missing in data pretreatment has a serious effect on the accuracy of subsequent analysis results in data mining. In this paper, the cause of data missing and the corresponding effect on data mining were discussed. Then the missing pattern and the application limitation of traditional missing va...

Full description

Saved in:
Bibliographic Details
Main Authors: Deng-Chao Feng, Zhe Wang, Jian-Fang Shi, Pereira, J.M.D.
Format: Conference Proceeding
Language:English
Subjects:
Algorithm design and analysis
Artificial neural networks
Classification algorithms
Data mining
Estimation
Expectation Maximization
Missing Value Estimation
Training
Wavelet Neural Network
Wavelet transforms
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Data missing in data pretreatment has a serious effect on the accuracy of subsequent analysis results in data mining. In this paper, the cause of data missing and the corresponding effect on data mining were discussed. Then the missing pattern and the application limitation of traditional missing value estimation were analyzed as well. Finally, the estimation algorithm of missing value in MAR (missing at random) pattern was mainly studied and applied in fault classification based on wavelet neural network. The experiment results show the efficiency of the algorithm.
DOI:10.1109/WCICA.2008.4593240