Robust Bayesian nonparametric variable selection for linear regression

Spike‐and‐slab and horseshoe regressions are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the data, which are common features in many real‐world statistics a...

Full description

Saved in:
Bibliographic Details
Published in:Stat (International Statistical Institute) 2024-06, Vol.13 (2), p.n/a
Main Authors: Cabezas, Alberto, Battiston, Marco, Nemeth, Christopher
Format: Article
Language:English
Subjects:
Algorithms
Bayesian analysis
Dirichlet problem
Dirichlet process
heteroskedasticity
horseshoe
Machine learning
Outliers (statistics)
Probabilistic models
Regression models
spike‐and‐slab
variable selection
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Spike‐and‐slab and horseshoe regressions are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the data, which are common features in many real‐world statistics and machine learning applications. This work proposes a Bayesian nonparametric approach to linear regression that performs variable selection while accounting for outliers and heteroskedasticity. Our proposed model is an instance of a Dirichlet process scale mixture model with the advantage that we can derive the full conditional distributions of all parameters in closed‐form, hence producing an efficient Gibbs sampler for posterior inference. Moreover, we present how to extend the model to account for heavy‐tailed response variables. The model's performance is tested against competing algorithms on synthetic and real‐world datasets.
ISSN:2049-1573
2049-1573
DOI:10.1002/sta4.696