Model selection for wavelet-based signal estimation

There has been a growing interest in wavelet-based methods for signal estimation from noisy samples. We compare popular wavelet thresholding methods with model selection using VC generalization bounds developed for finite samples. Since wavelet methods are linear (in parameters), the VC-dimension of...

Full description

Saved in:
Bibliographic Details
Main Authors: Cherkassky, V., Xuhui Shao
Format: Conference Proceeding
Language:English
Subjects:
Discrete wavelet transforms
Estimation
Noise reduction
Predictive models
Risk analysis
Signal denoising
Statistical learning
Training data
Virtual colonoscopy
Wavelet coefficients
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:There has been a growing interest in wavelet-based methods for signal estimation from noisy samples. We compare popular wavelet thresholding methods with model selection using VC generalization bounds developed for finite samples. Since wavelet methods are linear (in parameters), the VC-dimension of linear models can be accurately estimated. Successful application of VC-theory to wavelet denoising also requires specification of a suitable structure on a set of wavelet basis functions. We propose such a structure suitable for orthogonal basis functions, which includes wavelets as a special case. The combination of the proposed structure with VC bounds yields a new powerful method for signal estimation with wavelets. Our comparisons indicate that using VC bounds for model selection gives uniformly better results than other wavelet thresholding methods under small sample/high noise setting. On the other hand, with large samples model selection becomes trivial, and most reasonable methods (including wavelet thresholding heuristics) perform reasonably well.
ISSN:1098-7576
1558-3902
DOI:10.1109/IJCNN.1998.685877