Entrustable Professional Activities in General Surgery: Trends in Resident Self-Assessment

• Published in: Journal of surgical education 2020-11, Vol.77 (6), p.1562-1567
• Main Authors: Stahl, Christopher C., Jung, Sarah A., Rosser, Alexandra A., Kraut, Aaron S., Schnapp, Benjamin H., Westergaard, Mary, Hamedani, Azita G., Minter, Rebecca M., Greenberg, Jacob A.
• Format: Article
• Language: English
• Subjects: education; entrustable professional activities; self-assessment; surgery residency
• ISSN: 1931-7204; 1878-7452
• DOI: 10.1016/j.jsurg.2020.05.005

Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery. Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights. One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p < 0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κ = 0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κ = 0.58 vs 0.36). Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.