Crowd-Sourced Assessment of Surgical Skills of Urology Resident Applicants: Four-Year Experience

To determine a) if surgical skills among urology resident applicants could be reliably assessed via crowdsourcing and b) to what extent surgical skills testing impacts resident selection. Interviewees completed the following surgical skills tasks during their interview day: open knot tying (OKT), la...

Full description

Saved in:
Bibliographic Details
Published in:Journal of surgical education 2021-11, Vol.78 (6), p.2030-2037
Main Authors: Karani, Rajiv, Tapiero, Shlomi, Jefferson, Francis A., Vernez, Simone, Xie, Lillian, Larson, Krista N., Osann, Kathryn, Okhunov, Zhamshid, Patel, Roshan M., Landman, Jaime, Clayman, Ralph V., Stephany, Heidi A.
Format: Article
Language:English
Subjects:
Clinical Competence
Crowdsourcing
Humans
Internship and Residency
Laparoscopy
professional competence
surgery
urology
Urology - education
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To determine a) if surgical skills among urology resident applicants could be reliably assessed via crowdsourcing and b) to what extent surgical skills testing impacts resident selection. Interviewees completed the following surgical skills tasks during their interview day: open knot tying (OKT), laparoscopic peg transfer (LPT), and robotic suturing (RS). Urology faculty and crowd-workers evaluated each applicant's video-recorded performance using validated scoring and were assessed for agreement using Cronbach's alpha. Applicants’ USMLE scores, interview scores, and Jefferson Scale of Physician Empathy (JSPE-S) scores were assessed for correlation with skills testing scores and match rank. Additionally, a survey was distributed to interviewees assessing match outcomes. University of California Irvine Department of Urology, Surgical Skills Laboratory All 94 urology residency interviewees at the University of California Irvine Department of Urology from 2015-2018 were invited to complete the three surgical skills tasks on their interview day. Survey responses were received from all 94 interviewees (100%). Crowd and expert agreement was good (α=0.88), fair (α=0.67), and poor (α=0.32) for LPT, RS, and OKT scores, respectively. The skills testing scores did not correlate with match rank, USMLE score, or JSPE-S score. On multivariate analysis, only interview score (r= -0.723; p
ISSN:1931-7204
1878-7452
DOI:10.1016/j.jsurg.2021.05.005