Improving Effect Estimates by Limiting the Variability in Inverse Propensity Score Weights

This study describes a novel method to reweight a comparison group used for causal inference, so the group is similar to a treatment group on observable characteristics yet avoids highly variable weights that would limit statistical power. The proposed method generalizes the covariate-balancing prop...

Full description

Saved in:
Bibliographic Details
Published in:The American statistician 2021-07, Vol.75 (3), p.276-287
Main Authors: Kranker, Keith, Blue, Laura, Forrow, Lauren Vollmer
Format: Article
Language:English
Subjects:
Causal inference
Covariate balance
Estimates
Health care
Matching
Observational studies
Power
Primary care
Regression analysis
Statistical methods
Statistical power
Statistics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study describes a novel method to reweight a comparison group used for causal inference, so the group is similar to a treatment group on observable characteristics yet avoids highly variable weights that would limit statistical power. The proposed method generalizes the covariate-balancing propensity score (CBPS) methodology developed by Imai and Ratkovic ( 2014 ) to enable researchers to effectively prespecify the variance (or higher-order moments) of the matching weight distribution. This lets researchers choose among alternative sets of matching weights, some of which produce better balance and others of which yield higher statistical power. We demonstrate using simulations that our penalized CBPS approach can improve effect estimates over those from other established propensity score estimation approaches, producing lower mean squared error. We discuss applications where the method or extensions of it are especially likely to improve effect estimates and we provide an empirical example from the evaluation of Comprehensive Primary Care Plus, a U.S. health care model that aims to strengthen primary care across roughly 3000 practices. Programming code is available to implement the method in Stata.
ISSN:0003-1305
1537-2731
DOI:10.1080/00031305.2020.1737229