Can a teaching intervention reduce interobserver variability in LVEF assessment: a quality control exercise in the echocardiography lab

• Published in: JACC. Cardiovascular imaging 2011-08, Vol.4 (8), p.821-829
• Main Authors: Johri, Amer M, Picard, Michael H, Newell, John, Marshall, Jane E, King, Mary Etta E, Hung, Judy
• Format: Article
• Language: English
• Subjects: Analysis of Variance; Boston; Cardiology - education; Cardiology - standards; Clinical Competence; Clinical Laboratory Techniques - standards; Diagnostic Errors - prevention & control; Echocardiography - standards; Humans; Observer Variation; Predictive Value of Tests; Prognosis; Program Evaluation; Quality Control; Reproducibility of Results; Stroke Volume; Teaching - methods; Ventricular Dysfunction, Left - diagnostic imaging; Ventricular Dysfunction, Left - physiopathology; Ventricular Function, Left
• ISSN: 1876-7591
• DOI: 10.1016/j.jcmg.2011.06.004

This study sought to determine whether a formalized teaching intervention could reduce the interobserver variability (IOV) in visual estimation of left ventricular ejection fraction (LVEF) within a group of sonographers and physicians with a spectrum of experience. Precise and reliable echocardiographic assessment of LVEF is necessary for clinical decision-making and minimizing duplicative testing. Skill in the visual estimation of LVEF varies depending on experience and is critical for corroborating EF quantification. IOV may also lead to inconsistency if multiple readers are assessing the EF on serial exams. Fourteen cases of 2-dimensional echocardiograms were shown to 25 participants who estimated the EF based on a complete assessment of LV wall motion including parasternal, short-axis, apical, and subcostal views. The cases represented a spectrum of EF range, image quality, and clinical context. Following the initial interpretations, participants underwent a teaching intervention involving tutorial review of reference cases and group discussion of each case with determination of the EF guided by quantitative measure (biplane Simpson method). Three months after the teaching intervention, 14 new cases were shown to the 25 participants following the same methodology. IOV was quantified before and after the teaching intervention with the use of a 3-factor, nested analysis of variance. The factors were: observer, patient, and pre- and post-intervention (time). The analysis of variance showed that the intervention reduced the IOV for the 25 readers between the pre- and post-intervention assessments (F = 2.8, p = 0.007). The IOV decreased from ± 14% EF prior to intervention to ± 8.4% EF following intervention (a 40% reduction in IOV). In a large echocardiography laboratory with a wide range of training levels and experience, a simple, formalized teaching intervention can successfully diminish IOV of LVEF assessment. This intervention provides not only discrete quality measures, but also serves as a practical tool to document and improve quality of reporting, potentially reducing clinical inefficiencies and repeat testing.