Video-based interventions to improve self-assessment accuracy among physicians: A systematic review

• Published in: PloS one 2023-07, Vol.18 (7), p.e0288474-e0288474
• Main Authors: Pattni, Chandni, Scaffidi, Michael, Li, Juana, Genis, Shai, Gimpaya, Nikko, Khan, Rishad, Bansal, Rishi, Torabi, Nazi, Walsh, Catharine M, Grover, Samir C
• Format: Article
• Language: English
• Subjects: Accuracy; Analysis; Benchmarks; Career development; Clinical Competence; Clinical trials; Data analysis; Empirical analysis; Evaluation; Gastrointestinal surgery; Humans; Intervention; Medical care; Medical education; Medical students; Medicine and Health Sciences; Meta-analysis; Missing data; Pediatrics; People and Places; Physical Sciences; Physicians; Practice; Quality management; Research and Analysis Methods; Reviews; Risk assessment; Self assessment; Self evaluation; Skills; Statistical analysis; Systematic review; Validity
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0288474

Self-assessment of a physician's performance in both procedure and non-procedural activities can be used to identify their deficiencies to allow for appropriate corrective measures. Physicians are inaccurate in their self-assessments, which may compromise opportunities for self- development. To improve this accuracy, video-based interventions of physicians watching their own performance, an experts' performance or both, have been proposed to inform their self-assessment. We conducted a systematic review of the effectiveness of video-based interventions targeting improved self-assessment accuracy among physicians. The authors performed a systematic search of MEDLINE, Embase, EBM reviews, and Scopus databases from inception to August 23, 2022, using combinations of terms for "self-assessment", "video-recording", and "physician". Eligible studies were empirical investigations assessing the effect of video-based interventions on physicians' self-assessment accuracy with a comparison of self-assessment accuracy pre- and post- video intervention. We defined self-assessment accuracy as a "direct comparison between an external evaluator and self-assessment that was quantified using formal statistical analysis". Two reviewers independently screened records, extracted data, assessed risk of bias, and evaluated quality of evidence. A narrative synthesis was conducted, as variable outcomes precluded a meta-analysis. A total of 2,376 papers were initially retrieved. Of these, 22 papers were selected for full-text review; a final 9 studies met inclusion criteria for data extraction. Across studies, 240 participants from 5 specialties were represented. Video-based interventions included self-video review (8/9), benchmark video review (3/9), and/or a combination of both types (1/9). Five out of nine studies reported that participants had inaccurate self-assessment at baseline. After the intervention, 5 of 9 studies found a statistically significant improvement in self-assessment accuracy. Overall, current data suggests video-based interventions can improve self-assessment accuracy. Benchmark video review may enable physicians to improve self-assessment accuracy, especially for those with limited experience performing a particular clinical skill. In contrast, self-video review may be able to provide improvement in self-assessment accuracy for more experience physicians. Future research should use standardized methods of comparison for self-assessment accuracy, such as the