From Their Eyes: What Constitutes Quality Formative Written Feedback for Neurosurgery Residents

• Published in: Journal of surgical education 2023-03, Vol.80 (3), p.323-330
• Main Authors: Neal, Chris J., Durning, Steven J., Dharmapurikar, Rajeev, McDaniel, Katherine E., Lad, Shivanand P., Haglund, Michael M.
• Format: Article
• Language: English
• Subjects: Clinical Competence; Education; Feedback; Formative Feedback; Internship and Residency; Neurosurgery; Neurosurgery - education; Surgical Autonomy Program; Writing; Zone of Proximal Development
• ISSN: 1931-7204; 1878-7452
• DOI: 10.1016/j.jsurg.2022.10.003

•Focus resident feedback on specifics, key learning points, or their independence•Don't focus feedback solely on the next steps a resident needs to develop•Higher quality feedback results from using the Zone of Proximal Development process•If you don't remember a resident's performance, don't fill out an evaluation The characteristics of quality feedback from the neurosurgery resident's perspective are not fully elucidated. The Surgical Autonomy Program is an intraoperative assessment tool based on Vygotsky's Zone of Proximal Development (ZPD). SAP facilitates assessment of a resident's operative performance accompanied by written feedback. The goal of this study was twofold: to identify themes from the written feedback of SAP operative assessments and to examine if these themes influenced the neurosurgery residents’ perception of feedback quality. In 2021, SAP data from 2019-2021 at two neurosurgery programs were reviewed. Feedback quality from the SAP was determined by the resident at the time of their assessment. Using a constant comparative technique, the feedback was coded using a thematic analysis. The quality of feedback within each code was analyzed. There were 2968 SAP entries evaluated. When the ZPD concept was fully used, residents reported high quality feedback 91.4% of the time compared to 58.6% when ZPD was not used (p < 0.001). Qualitative analysis of the written feedback revealed five themes: Non-Specific, Specific General Observations, Key Points, Next Steps, and Independent Practice. Feedback in the Specific General Observations, Key Points, and Independent Practice categories were associated with higher level feedback than leaving the space blank (p < 0.001) or writing Non-Specific comments (p < 0.001). Providing comments that discuss the resident's specific performance in the case, key learning points, or their progress towards independence, results in high quality feedback. Utilizing a theory-based tool such as the SAP can provide meaningful feedback to neurosurgical residents.