Psychometric Properties of an Instrument Designed to Measure the Educational Quality of Graduate Training Programs

To assess the quality of residency education programs at an academic medical center for purposes of enhancing individual graduate medical education programs, we asked residents and fellows (N = 419) to evaluate their training programs using a Web-based questionnaire (response rate = 70%). Kruskal-Wa...

Full description

Saved in:
Bibliographic Details
Published in:Evaluation & the health professions 2004-12, Vol.27 (4), p.410-424
Main Authors: Bierer, S. Beth, Fishleder, Andrew J., Dannefer, Elaine, Farrow, Nancy, Hull, Alan L.
Format: Article
Language:English
Subjects:
Adult
Cronbach's alpha
Educational programs
Exploratory factor analysis
Factor Analysis, Statistical
Female
Generalizability
Health administration
Health technology assessment
Humans
Internet
Internship and Residency
Male
Measurement
Medical education
Postgraduate medical education
Practice placements
Program Evaluation
Programmes
Psychometrics
Quality control
Quantitative psychology
Questionnaires
Reproducibility of Results
Response rates
Surveys and Questionnaires
Training
United States
USA
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To assess the quality of residency education programs at an academic medical center for purposes of enhancing individual graduate medical education programs, we asked residents and fellows (N = 419) to evaluate their training programs using a Web-based questionnaire (response rate = 70%). Kruskal-Wallis tests, factor analysis, correlations, generalizability/decision studies, and mean plots were used to examine trainee responses and to assess the questionnaire’s measurement properties. Exploratory factor analysis indicated that the instrument had a threefactor structure that correlated highly with overall program rating. Cronbach’s alpha exceeded .80 for all factors, and decision studies revealed that 13 to 23 raters were needed to obtain G-coefficients greater than .70. Mean plots showed that the instrument could discriminate within and among training programs at the item level and the factor level, which should help target improvements across graduate training programs within large institutions.
ISSN:0163-2787
1552-3918
DOI:10.1177/0163278704270006