Surgeons' Attitude Toward a Competency-Based Training and Assessment Program: Results of a Multicenter Survey

• Published in: Journal of surgical education 2013-09, Vol.70 (5), p.647-654
• Main Authors: Hopmans, Cornelis J., MD, den Hoed, Pieter T., PhD, Wallenburg, Iris, PhD, van der Laan, Lijkckle, PhD, van der Harst, Erwin, PhD, van der Elst, Maarten, PhD, Mannaerts, Guido H.H., PhD, Dawson, Imro, PhD, van Lanschot, Jan J.B., PhD, IJzermans, Jan N.M., PhD
• Format: Article
• Language: English
• Subjects: Adult; Attitude of Health Personnel; Clinical Competence; Competency-Based Education - organization & administration; Data Collection; Educational Measurement; Female; general surgery; General Surgery - education; Humans; Internship and Residency; Interpersonal and Communication Skills; Male; Medical Knowledge; Netherlands; postgraduate training; Practice-Based Learning and Improvement; Professionalism; Program Evaluation; quantitative research methods; Surgery; Systems-Based Practice
• ISSN: 1931-7204; 1878-7452
• DOI: 10.1016/j.jsurg.2013.04.015

Background Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents’ competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. Methods In 2011, all residents ( n = 51) and attending surgeons ( n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach’s α, and the Mann-Whitney test was applied to assess differences between groups. Results The response rate was 88% ( n = 140). The CanMEDS framework demonstrated good reliability (Cronbach’s α = 0.87). However, the importance of the competencies ‘Manager’ (78%) and ‘Health Advocate’ (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach’s α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools ‘in-training evaluation report’ (91%) and ‘objective structured assessment of technical skill’ (82%). No significant differences were found between the residents and the attending surgeons. Conclusion This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large training region in the Netherlands do not acknowledge the importance of all CanMEDS competencies and consider the assessment tools generally unsuitable for competence evaluation.