The concordance filter: an adaptive model-free feature screening procedure

A new model-free and data-adaptive feature screening procedure referred to as the concordance filter is developed for ultrahigh-dimensional data. The proposed method is based on the concordance filter which measures concordance between random vectors and can work adaptively with several types of pre...

Full description

Saved in:
Bibliographic Details
Published in:Computational statistics 2024-07, Vol.39 (5), p.2413-2436
Main Authors: Cheng, Xuewei, Li, Gang, Wang, Hong
Format: Article
Language:English
Subjects:
Economic Theory/Quantitative Economics/Mathematical Methods
Mathematics and Statistics
Original Paper
Probability and Statistics in Computer Science
Probability Theory and Stochastic Processes
Statistics
Survival analysis
Variables
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A new model-free and data-adaptive feature screening procedure referred to as the concordance filter is developed for ultrahigh-dimensional data. The proposed method is based on the concordance filter which measures concordance between random vectors and can work adaptively with several types of predictors and response variables. We apply the concordance filter to deal with feature screening problems emerging from a wide range of real applications, such as nonparametric regression and survival analysis, among others. It is shown that the concordance filter enjoys the sure screening and rank consistency properties under weak regularity conditions. In particular, the concordance filter can still be powerful in the presence of censoring and heavy tails. We further demonstrate the superior performance of the concordance filter over existing screening methods by numerical examples and medical applications.
ISSN:0943-4062
1613-9658
DOI:10.1007/s00180-023-01399-5