A Conceptual Framework for a Psychometric Theory for Standard Setting with Examples of Its Use for Evaluating the Functioning of Two Standard Setting Methods

A conceptual framework is proposed for a psychometric theory of standard setting. The framework suggests that participants in a standard setting process (panelists) develop an internal, intended standard as a result of training and the participant's background. The goal of a standard setting pr...

Full description

Saved in:
Bibliographic Details
Published in:Educational measurement, issues and practice issues and practice, 2006-06, Vol.25 (2), p.4-18
Main Author: Reckase, Mark D.
Format: Article
Language:English
Subjects:
bookmark method
Concept Formation
Cutting Scores
Data collection
Educational Policy
Errors
Essays
Estimates
Evaluation Criteria
Evaluation Methods
Item Response Theory
Methods
modified Angoff method
psychometric theory
Psychometrics
Scoring Rubrics
Standard Setting
Standard Setting (Scoring)
Task Analysis
Theory
True Scores
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A conceptual framework is proposed for a psychometric theory of standard setting. The framework suggests that participants in a standard setting process (panelists) develop an internal, intended standard as a result of training and the participant's background. The goal of a standard setting process is to convert panelists' intended standards to points on a test's score scale. Psychometrics is involved in this process because the points on the score scale are estimated from ratings provided by participants. The conceptual framework is used to derive three criteria for evaluating standard setting processes. The use of these criteria is demonstrated by applying them to variations of bookmark and modified Angoff standard setting methods.
ISSN:0731-1745
1745-3992
DOI:10.1111/j.1745-3992.2006.00052.x