Some children left behind: Variation in the effects of an educational intervention

We document substantial variation in the effects of a highly-effective literacy program in northern Uganda. The program increases test scores by 1.4 SDs on average, but standard statistical bounds show that the impact standard deviation exceeds 1.0 SD. This implies that the variation in effects acro...

Full description

Saved in:
Bibliographic Details
Published in:Journal of econometrics 2024-07, Vol.243 (1-2), p.105256, Article 105256
Main Authors: Buhl-Wiggers, Julie, Kerwin, Jason T., Muñoz-Morales, Juan, Smith, Jeffrey, Thornton, Rebecca
Format: Article
Language:English
Subjects:
Economics and Finance
Education programs
Humanities and Social Sciences
Machine learning
Treatment effect heterogeneity
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We document substantial variation in the effects of a highly-effective literacy program in northern Uganda. The program increases test scores by 1.4 SDs on average, but standard statistical bounds show that the impact standard deviation exceeds 1.0 SD. This implies that the variation in effects across our students is wider than the spread of mean effects across all randomized evaluations of developing country education interventions in the literature. This very effective program does indeed leave some students behind. At the same time, we do not learn much from our analyses that attempt to determine which students benefit more or less from the program. We reject rank preservation, and the weaker assumption of stochastic increasingness leaves wide bounds on quantile-specific average treatment effects. Neither conventional nor machine-learning approaches to estimating systematic heterogeneity capture more than a small fraction of the variation in impacts given our available candidate moderators.
ISSN:0304-4076
DOI:10.1016/j.jeconom.2021.12.010