Analyzing Grouped Administrative Data for RCTs Using Design-Based Methods

This article discusses estimation of average treatment effects for randomized controlled trials (RCTs) using grouped administrative data to help improve data access. The focus is on design-based estimators, derived using the building blocks of experiments, that are conducive to grouped data for a wi...

Full description

Saved in:
Bibliographic Details
Published in:Journal of educational and behavioral statistics 2020-02, Vol.45 (1), p.32-57
Main Author: Schochet, Peter Z.
Format: Article
Language:English
Subjects:
Computation
Data Analysis
Educational Research
Educational tests & measurements
Multivariate Analysis
Randomized Controlled Trials
Regression analysis
Research Design
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article discusses estimation of average treatment effects for randomized controlled trials (RCTs) using grouped administrative data to help improve data access. The focus is on design-based estimators, derived using the building blocks of experiments, that are conducive to grouped data for a wide range of RCT designs, including clustered and blocked designs, and models with weights and covariates. Because of the linearity of the regression model underlying RCTs, the asymptotic properties of design-based estimators using group-level averages—formed randomly or by covariates for nonclustered designs and as cluster-level averages for clustered designs—match those using individual data. Furthermore, design effects from aggregation are tolerable with moderate numbers of groups and few covariates, suggesting little information is lost in these cases. Ecological inference methods for subgroup analyses, however, yield large design effects. Several empirical examples using real-world education RCT data demonstrate the theory.
ISSN:1076-9986
1935-1054
DOI:10.3102/1076998619855350