Learner engagement and teaching effectiveness in livestreamed versus in‐person CME

• Published in: Medical education 2023-04, Vol.57 (4), p.349-358
• Main Authors: Stephenson, Christopher R., Yudkowsky, Rachel, Wittich, Christopher M., Cook, David A.
• Format: Article
• Language: English
• Subjects: Audiences; Continuing education; Education, Medical, Continuing; Educational technology; Humans; Learning; Medical education; Surveys and Questionnaires; Teaching; Teaching methods; Telemedicine; Variance analysis; Video teleconferencing
• ISSN: 0308-0110; 1365-2923
• DOI: 10.1111/medu.14996

Introduction Engaging learners in continuing medical education (CME) is challenging. Recently, CME courses have transitioned to livestreamed CME, with learners viewing live, in‐person courses online. The authors aimed to (1) compare learner engagement and teaching effectiveness in livestreamed with in‐person CME and (2) determine how livestream engagement and teaching effectiveness is associated with (A) interactivity metrics, (B) presentation characteristics and (C) medical knowledge. Methods A 3‐year, non‐randomised study of in‐person and livestream CME was performed. The course was in‐person for 2018 but transitioned to livestream for 2020 and 2021. Learners completed the Learner Engagement Inventory and Teaching Effectiveness Instrument after each presentation. Both instruments were supported by content, internal structure and relations to other variables' validity evidence. Interactivity metrics included learner use of audience response, questions asked by learners and presentation views. Presentation characteristics included presentations using audience response, using pre/post‐test format, time of day and words per slide. Medical knowledge was assessed by audience response. A repeated measures analysis of variance (anova) was used for comparisons and a mixed model approach for correlations. Results A total of 159 learners (response rate 27%) completed questionnaires. Engagement did not significantly differ between in‐person or livestream CME. (4.56 versus 4.53, p = 0.64, maximum 5 = highly engaged). However, teacher effectiveness scores were higher for in‐person compared with livestream (4.77 versus 4.71 p = 0.01, maximum 5 = highly effective). For livestreamed courses, learner engagement was associated with presentation characteristics, including presentation using of audience response (yes = 4.57, no = 4.45, p