Loading…

Bias in Open Peer-Review: Evidence from the English Superior Courts

This paper explores possible biases in open peer-review using data from the English superior courts. Exploiting the random timing of on-the-job interaction between reviewers and reviewees, we find evidence that reviewers are reluctant to reverse the judgments of reviewees with whom they are about to...

Full description

Saved in:
Bibliographic Details
Published in:Journal of law, economics, & organization economics, & organization, 2015-08, Vol.31 (3), p.431-471
Main Authors: Blanes i Vidal, Jordi, Leaver, Clare
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper explores possible biases in open peer-review using data from the English superior courts. Exploiting the random timing of on-the-job interaction between reviewers and reviewees, we find evidence that reviewers are reluctant to reverse the judgments of reviewees with whom they are about to interact, and that this effect is stronger when reviewer and reviewee share the same rank. The average bias is substantial: the proportion of reviewer affirmances is 30% points higher in the group where reviewers know they will soon work with their reviewee, relative to groups where such interaction is absent. Our results suggest reforms for the judicial listing process, and caution against recent trends in performance appraisal techniques and scientific publishing.
ISSN:8756-6222
1465-7341
DOI:10.1093/jleo/ewv004