Gain Scores Revisited: A Graphical Models Perspective

For misguided reasons, social scientists have long been reluctant to use gain scores for estimating causal effects. This article develops graphical models and graph-based arguments to show that gain score methods are a viable strategy for identifying causal treatment effects in observational studies...

Full description

Saved in:
Bibliographic Details
Published in:Sociological methods & research 2021-08, Vol.50 (3), p.1353-1375
Main Authors: Kim, Yongnam, Steiner, Peter M.
Format: Article
Language:English
Subjects:
Adjustment
Analysis of covariance
Bias
Causal Models
Causality
Conditioning
Graphical models
Graphs
Measurement
Measurement errors
Observation
Observational studies
Pretests Posttests
Scores
Statistical Bias
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:For misguided reasons, social scientists have long been reluctant to use gain scores for estimating causal effects. This article develops graphical models and graph-based arguments to show that gain score methods are a viable strategy for identifying causal treatment effects in observational studies. The proposed graphical models reveal that gain score methods rely on a bias-removing mechanism that is quite different to regular matching or covariance adjustment. While gain score methods offset noncausal associations via differencing, matching or covariance adjustment blocks noncausal association via conditioning. Since gain score estimators do not rely on conditioning, they are immune to measurement error in the pretest, bias amplification, and collider bias. The graph-based arguments also demonstrate that the key identifying assumption for gain score methods, the common trend assumption, is difficult to assess and justify when the pretest causally affects treatment assignment. Finally, we discuss the distinct role of pretests in the context of Lord’s paradox.
ISSN:0049-1241
1552-8294
DOI:10.1177/0049124119826155