Program Director Perceptions of Usefulness of the Accreditation Council for Graduate Medical Education Milestones System for Urology Resident Evaluation

• Published in: Urology (Ridgewood, N.J.) N.J.), 2019-02, Vol.124, p.28-32
• Main Authors: Sebesta, Elisabeth M., Cooper, Kimberly L., Badalato, Gina M.
• Format: Article
• Language: English
• Subjects: Accreditation; Education, Medical, Graduate; Internship and Residency; Surveys and Questionnaires; Urology - education
• ISSN: 0090-4295; 1527-9995
• DOI: 10.1016/j.urology.2018.10.042

To assess the application and perceived usefulness of the Accreditation Council for Graduation Medical Education Milestones system for resident evaluation among urology program directors (PDs). We conducted an online survey of 133 urology PDs. The survey addressed several domains: (1) demographic information, (2) logistics and implementation of the faculty Clinical Competency Committee meetings, and (3) perceived overall effectiveness and usefulness of the Milestones assessments. Eighty-eight responses were obtained (66% response rate). A total of 42/88 programs (48%) described the Milestones as very or somewhat unhelpful in resident evaluation, with a comparable proportion (44%) responding Milestones assessments never or almost never accurately distinguished between residents. Respondents felt higher scores on all domains of the Milestones were completely or somewhat uncorrelated to higher in-service examination scores (58%), with a smaller fraction (49%) deeming they were not predictive of board passage rates. Overall, 30% of respondents answered neutrally as to whether they felt the Milestones format has led to better resident formative feedback, and 35% were neutral as to the implications of this system toward promoting professional development. The Accreditation Council for Graduation Medical Education Milestones system for resident evaluation was initiated to create a uniform competency-based assessment system; however, a sizable proportion of urology PDs in our cohort did not find the Milestones system helpful or accurate in assessing residents or predicting future successes. Given the Milestones system is still in its infancy, the utility of this system within urology has yet to be fully assessed.