Multi-modes for Detecting Experimental Measurement Error

Experiments should be designed to facilitate the detection of experimental measurement error. To this end, we advocate the implementation of identical experimental protocols employing diverse experimental modes. We suggest iterative nonparametric estimation techniques for assessing the magnitude of...

Full description

Saved in:
Bibliographic Details
Published in:Political analysis 2020-04, Vol.28 (2), p.263-283
Main Authors: Duch, Raymond, Laroze, Denise, Robinson, Thomas, Beramendi, Pablo
Format: Article
Language:English
Subjects:
Earnings
Estimation
Experiments
Heterogeneity
Internet
Measurement errors
Researchers
Social networks
Social sciences
Statistical analysis
Workers
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Experiments should be designed to facilitate the detection of experimental measurement error. To this end, we advocate the implementation of identical experimental protocols employing diverse experimental modes. We suggest iterative nonparametric estimation techniques for assessing the magnitude of heterogeneous treatment effects across these modes. And we propose two diagnostic strategies—measurement metrics embedded in experiments, and measurement experiments—that help assess whether any observed heterogeneity reflects experimental measurement error. To illustrate our argument, first we conduct and analyze results from four identical interactive experiments: in the lab; online with subjects from the CESS lab subject pool; online with an online subject pool; and online with MTurk workers. Second, we implement a measurement experiment in India with CESS Online subjects and MTurk workers.
ISSN:1047-1987
1476-4989
DOI:10.1017/pan.2019.34