Internal evaluation of medical programs is more than housework: A scoping review

• Published in: PloS one 2024-10, Vol.19 (10), p.e0305996
• Main Authors: Kodagoda Gamage, Sujani, Jowsey, Tanisha, Bishop, Jo, Forbes, Melanie, Grant, Lucy-Jane, Green, Patricia, Houghton, Helen, Links, Matthew, Morgan, Mark, Roehl, Joan, Stokes-Parish, Jessica
• Format: Article
• Language: English
• Subjects: Accreditation; Curricula; Curriculum; Curriculum evaluation; Education; Education, Medical; Educational evaluation; Housework; Humans; Literature reviews; Medical education; Medical research; Medical schools; Methods; Professionals; Program Evaluation; Quality management; Quality of education; Quality standards; Registration; Schools; Schools, Medical; Software; Systematic review; Well being
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0305996

The aim of this scoping review was to explore current program evaluation practices across various medical schools. We conducted searches in MEDLINE (Ovid), Embase (Elsevier) and ERIC (ed.gov) for original research and review articles related to medical education evaluation with key words evaluation, program, medical education, pre-registration, framework, curriculum, outcomes, evaluation, quality. We followed Arksey and O'Malley's (2005) process for scoping reviews. Thirty-two articles were included. Studies were primarily concerned with either proving (n = 21) or improving efficacy of their programs (n = 11). No studies aimed at comparing programs. Nine were literature reviews. Others aimed to develop a new evaluation model (n = 7) or apply (n = 12) or validate (n = 4) an existing model (or part thereof). Twenty-two studies explicitly identified an evaluation model they had used or would recommend. Most frequently used models for evaluation were: Context-Input-Process-Product, Kirkpatrick, World Federation Medical Education, and the Standards by Joint Committee on Standards for Educational Evaluation. Overall, evaluations were learner-focused and accreditation driven with a minority considering the broader influences of program success. Program evaluation is fundamental to driving the quality of education delivered to produce workforce-ready healthcare professionals. The focus of current evaluations is on student experience and content delivery with a significant gap in the existing literature on evaluation related to staff, learner/staff well-being, equity, diversity, and meta evaluation.