Model averaging with the hybrid model: An asymptotic study and demonstration

In this paper, we present a new model averaging technique that can be applied in medical research. The dataset is first partitioned by the values of its categorical explanatory variables. Then for each partition, a model average is determined by minimising some form of squared errors, which could be...

Full description

Saved in:
Bibliographic Details
Published in:Statistical methods in medical research 2022-04, Vol.31 (4), p.658-672
Main Authors: Wee Soh, Kian, Lumley, Thomas, Walker, Cameron, O’Sullivan, Michael
Format: Article
Language:English
Subjects:
Asymptotic properties
Biomedical Research
Computer Simulation
Errors
Medical research
Partition
Research Design
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we present a new model averaging technique that can be applied in medical research. The dataset is first partitioned by the values of its categorical explanatory variables. Then for each partition, a model average is determined by minimising some form of squared errors, which could be the leave-one-out cross-validation errors. From our asymptotic optimality study and the results of simulations, we demonstrate under several high-level assumptions and modelling conditions that this model averaging procedure may outperform jackknife model averaging, which is a well-established technique. We also present an example where a cross-validation procedure does not work (that is, a zero-valued cross-validation error is obtained) when determining the weights for model averaging.
ISSN:0962-2802
1477-0334
DOI:10.1177/09622802211041750