Peer Ratings: Scoring Strategy Development and Reliability Demonstration on Air Force Basic Trainees

Peer ratings were obtained from over 27,000 Basic Trainees. An effective method was developed for scoring them by algebraically summing the positive and negative ratings. A modification of the Spearman-Brown prophecy formula was used to determine interrater reliability coefficients which were adjust...

Full description

Saved in:
Bibliographic Details
Main Authors: Borman, Walter C, Rosse, Rodney L
Format: Report
Language:English
Subjects:
AIR FORCE PERSONNEL
AIR FORCE TRAINING
BASIC TRAINING
Humanities and History
INTERPERSONAL RELATIONS
MATHEMATICAL PREDICTION
PE62703F
PEER RATINGS
PERFORMANCE(HUMAN)
Psychology
RATINGS
RELIABILITY
SCORING
STATISTICAL ANALYSIS
TRAINEES
WUAFHRL77190252
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Peer ratings were obtained from over 27,000 Basic Trainees. An effective method was developed for scoring them by algebraically summing the positive and negative ratings. A modification of the Spearman-Brown prophecy formula was used to determine interrater reliability coefficients which were adjusted to the mean number of trainees in the flights. The peer ratings yielded uniformly high interrater reliability coefficients which indicated substantial agreement among raters. It was concluded that the method developed for norming peer ratings from different size groups was valuable and could be applied to standardize future peer ratings. Peer ratings thus show promise for performance appraisal when normed using this method.