Consistent tuning parameter selection in high-dimensional group-penalized regression

Various forms of penalized estimators with good statistical and computational properties have been proposed for variable selection respecting the grouping structure in the variables. The attractive properties of these shrinkage and selection estimators, however, depend critically on the choice of th...

Full description

Saved in:
Bibliographic Details
Published in:Science China. Mathematics 2019-04, Vol.62 (4), p.751-770
Main Authors: Li, Yaguang, Wu, Yaohua, Jin, Baisuo
Format: Article
Language:English
Subjects:
Applications of Mathematics
Bayesian analysis
Computer simulation
Criteria
Estimators
Mathematics
Mathematics and Statistics
Parameters
Selectors
Shrinkage
Statistical analysis
Tuning
Variables
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Various forms of penalized estimators with good statistical and computational properties have been proposed for variable selection respecting the grouping structure in the variables. The attractive properties of these shrinkage and selection estimators, however, depend critically on the choice of the tuning parameter. One method for choosing the tuning parameter is via information criteria, such as the Bayesian information criterion (BIC). In this paper, we consider the problem of consistent tuning parameter selection in high dimensional generalized linear regression with grouping structures. We extend the results of the extended regularized information criterion (ERIC) to group selection methods involving concave penalties and then investigate the selection consistency with diverging variables in each group. Moreover, we show that the ERIC-type selector enables consistent identification of the true model and that the resulting estimator possesses the oracle property even when the number of group is much larger than the sample size. Simulations show that the ERIC-type selector can significantly outperform the BIC and cross-validation selectors when choosing true grouped variables, and an empirical example is given to illustrate its use.
ISSN:1674-7283
1869-1862
DOI:10.1007/s11425-017-9189-9