Evaluation of a multi‐methods approach to the collection and dissemination of feedback on OSCE performance in dental education

• Published in: European journal of dental education 2018-05, Vol.22 (2), p.e203-e211
• Main Authors: Wardman, M.J., Yorke, V.C., Hallam, J.L.
• Format: Article
• Language: English
• Subjects: assessment; audio; Data analysis; Data processing; dental education; Dental schools; Dentistry; Educational evaluation; examination; Feedback; learning impact; OSCE; Response rates; Students; written
• ISSN: 1396-5883; 1600-0579
• DOI: 10.1111/eje.12273

Introduction Feedback is an essential part of the learning process, and students expect their feedback to be personalised, meaningful and timely. Objective Structured Clinical Examination (OSCE) assessments allow examiners to observe students carefully over the course of a number of varied station types, across a number of clinical knowledge and skill domains. They therefore present an ideal opportunity to record detailed feedback which allows students to reflect on and improve their performance. Methods This article outlines two methods by which OSCE feedback was collected and then disseminated to undergraduate dental students across 2‐year groups in a UK dental school: (i) Individual written feedback comments made by examiners during the examination, (ii) General audio feedback recorded by groups of examiners immediately following the examination. Evaluation of the feedback was sought from students and staff examiners. A multi‐methods approach utilising Likert questionnaire items (quantitative) and open‐ended feedback questions (qualitative) was used. Data analysis explored student and staff perceptions of the audio and written feedback. Results A total of 131 students (response rate 68%) and 52 staff examiners (response rate 83%) completed questionnaires. Quantitative data analysis showed that the written and audio formats were reported as a meaningful source of feedback for learning by both students (93% written, 89% audio) and staff (96% written, 92% audio). Qualitative data revealed the complementary nature of both types of feedback. Written feedback gives specific, individual information whilst audio shares general observations and allows students to learn from others. The advantages, limitations and challenges of the feedback methods are discussed, leading to the development of an informed set of implementation guidelines. Conclusion Written and audio feedback methods are valued by students and staff. It is proposed that these may be very easily applied to OSCEs running in other dental schools.