Performance Evaluation: Subjectivity, Bias and Judgment Style in Sport

The number of situations that require individual judgments and evaluations, and that may be object of different sources of conscious and unconscious biases is endless. This paper proposes a practical score aggregation procedure that attempts to reduce and mitigate the influence of bias in subjective...

Full description

Saved in:
Bibliographic Details
Published in:Group decision and negotiation 2020-08, Vol.29 (4), p.655-678
Main Author: Osório, António
Format: Article
Language:English
Subjects:
Bias
Biological and Physical Anthropology
Business and Management
Olympic games
Subjectivity
Unconsciousness
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The number of situations that require individual judgments and evaluations, and that may be object of different sources of conscious and unconscious biases is endless. This paper proposes a practical score aggregation procedure that attempts to reduce and mitigate the influence of bias in subjective judgments. The argument is based on the idea that bias is associated with deviations from the panel mean and/or deviations from the judges’ grading style. Consequently, the procedure is not specific to a particular type of bias, but rather addresses general forms of bias. We also discuss a set of desirable properties. The proposed score aggregation procedure is then applied to a unique data set from the 2000 Summer Olympic Games diving competition.
ISSN:0926-2644
1572-9907
DOI:10.1007/s10726-020-09672-4