Selective inference in regression models with groups of variables

We provide a general mathematical framework for selective inference with supervised model selection procedures characterized by quadratic forms in the outcome variable. Forward stepwise with groups of variables is an important special case as it allows models with categorical variables or factors. M...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2015-11
Main Authors: Loftus, Joshua R, Taylor, Jonathan E
Format: Article
Language:English
Subjects:
Inference
Programming languages
Quadratic forms
Regression models
Statistical analysis
Variables
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We provide a general mathematical framework for selective inference with supervised model selection procedures characterized by quadratic forms in the outcome variable. Forward stepwise with groups of variables is an important special case as it allows models with categorical variables or factors. Models can be chosen by AIC, BIC, or a fixed number of steps. We provide an exact significance test for each group of variables in the selected model based on an appropriately truncated \(\chi\) or \(F\) distribution for the cases of known and unknown \(\sigma^2\) respectively. An efficient software implementation is available as a package in the R statistical programming language.
ISSN:2331-8422