The Development and Execution of An Orthopaedic Sports Medicine Fellowship Surgical Skills Assessment

• Published in: The American journal of sports medicine 2024-09, Vol.52 (11), p.2702-2708
• Main Authors: Thacher, Ryan R., White, Alexander E., Camp, Christopher L., Matava, Matthew J., Dugas, Jeffrey R., Ranawat, Anil S.
• Format: Article
• Language: English
• Subjects: Medicine; Orthopedics; Sports medicine
• ISSN: 0363-5465; 1552-3365; 1552-3365
• DOI: 10.1177/03635465241270160

Background: Assessment of orthopaedic surgery trainees is traditionally based on subjective evaluation by faculty. The recent push for value-based health care has placed a premium on improving patient outcomes. As a result, surgical training evaluations for orthopaedic trainees are evolving to include more objective measures to evaluate competency. Purpose: To develop and subsequently demonstrate the efficacy of a novel surgical skills assessment for orthopaedic sports medicine fellows. Study Design: Case series; Level of evidence, 4. Methods: A team of 14 fellowship-trained orthopaedic sports medicine surgeons developed objective scoring rubrics for anterior cruciate ligament reconstruction (ACLR) and rotator cuff repair (RCR) using a modified Delphi process. Rubrics were designed based on 10 surgical steps with a grading scale (1-5) based on core competencies with a maximum summative score of 50. Fourteen orthopaedic fellows across a regionally diverse group of sports medicine–accredited fellowship programs were invited to complete both an ACLR and RCR in a surgical skills laboratory at the beginning and end of their fellowship year. Individual surgical steps, overall performance, and total procedure time were evaluated by a single sports medicine surgeon for both sessions. Results: Thirteen of 14 fellows completed both pre- and post-fellowship assessments. For the ACLR procedure, the pre-fellowship mean summative score was 25.4 (SD, 4.4) and the post-fellowship mean summative score was 38.6 (SD, 4.1), which was a statistically significant improvement (P < .001). For the RCR procedure, the pre-fellowship mean summative score was 26.6 (SD, 5.4) and the post-fellowship mean summative score was 38.8 (SD, 4.3), which was also a statistically significant improvement (P < .001). The mean time to completion for the ACLR procedure was 82.3 minutes (SD, 4.3 minutes) pre-fellowship, which improved to 69.7 minutes (SD, 11.6 minutes) post-fellowship (P = .002). The mean time to completion for the RCR procedure was 85.5 minutes (SD, 5.0 minutes) pre-fellowship, which improved to 76.4 minutes (SD, 7.0 minutes) post-fellowship (P < .001). Conclusion: This surgical skills program represents the first standardized and reproducible instrument for the evaluation of 2 arthroscopic sports medicine procedures in the United States. Orthopaedic sports medicine fellows improved significantly in aggregate over their fellowship year with regard to the ACLR and RCR. The described p