Computerized Adaptive Testing in Instructional Settings

Item response theory (IRT) has most often been used in research on computerized adaptive testing (CAT). Depending on the model used, IRT requires between 200 and 1,000 examinees for estimating item parameters. Thus, it is not practical for instructional designers to develop their own CAT based on th...

Full description

Saved in:
Bibliographic Details
Published in:Educational technology research and development 1993-01, Vol.41 (3), p.47-62
Main Authors: Welch, R. Edwin, Frick, Theodore W.
Format: Article
Language:English
Subjects:
Adaptive Testing
Algorithms
Biological and medical sciences
Classrooms
Computer Assisted Testing
Computers in education
Confidence interval
Educational psychology
Estimation methods
Expert Systems
Fundamental and applied biological sciences. Psychology
Higher Education
Item Response Theory
Mastery learning
Mastery Tests
Mathematical Formulas
Maximum likelihood estimation
Orientation. Evaluation
Point estimators
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Sequential Probability Ratio Test (Wald)
Test Reliability
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Item response theory (IRT) has most often been used in research on computerized adaptive testing (CAT). Depending on the model used, IRT requires between 200 and 1,000 examinees for estimating item parameters. Thus, it is not practical for instructional designers to develop their own CAT based on the IRT model. Frick improved Wald's sequential probability ratio test (SPRT) by combining it with normative expert systems reasoning, referred to as an EXSPRT-based CAT. While previous studies were based on re-enactments from historical test data, the present study is the first to examine how well these adaptive methods function in a real-time testing situation. Results indicate that the EXSPRT-I significantly reduced test lengths and was highly accurate in predicting mastery. EXSPRT is apparently a viable and practical alternative to IRT for assessing mastery of instructional objectives.
ISSN:1042-1629
1556-6501
DOI:10.1007/BF02297357