The learning curve, interobserver, and intraobserver agreement of endoscopic confocal laser endomicroscopy in the assessment of mucosal barrier defects

• Published in: Gastrointestinal endoscopy 2016-04, Vol.83 (4), p.785-791.e1
• Main Authors: Chang, Jeff, BSc(Med), MBBS, FRACP, Ip, Matthew, Yang, Michael, Wong, Brendon, Power, Theresa, BMedSci, BMBS, FRCPA, Lin, Lisa, BSc(Med), MBBS, FRCPA, Xuan, Wei, MSc, MAppStat, PhD, Phan, Tri Giang, MBBS, FRACP, FRCPA, PhD, Leong, Rupert W., MBBS, FRACP, MD, AGAF
• Format: Article
• Language: English
• Subjects: Clinical Competence; Endoscopy, Gastrointestinal; Gastroenterology and Hepatology; Humans; Inflammatory Bowel Diseases - diagnostic imaging; Inflammatory Bowel Diseases - pathology; Inflammatory Bowel Diseases - physiopathology; Intestinal Mucosa - diagnostic imaging; Intestinal Mucosa - metabolism; Intestinal Mucosa - pathology; Learning Curve; Microscopy, Confocal - standards; Observer Variation; Permeability
• ISSN: 0016-5107; 1097-6779
• DOI: 10.1016/j.gie.2015.08.045

Background and Aims Confocal laser endomicroscopy can dynamically assess intestinal mucosal barrier defects and increased intestinal permeability (IP). These are functional features that do not have corresponding appearance on histopathology. As such, previous pathology training may not be beneficial in learning these dynamic features. This study aims to evaluate the diagnostic accuracy, learning curve, inter- and intraobserver agreement for identifying features of increased IP in experienced and inexperienced analysts and pathologists. Methods A total of 180 endoscopic confocal laser endomicroscopy (Pentax EC-3870FK; Pentax, Tokyo, Japan) images of the terminal ileum, subdivided into 6 sets of 30 were evaluated by 6 experienced analysts, 13 inexperienced analysts, and 2 pathologists, after a 30-minute teaching session. Cell-junction enhancement, fluorescein leak, and cell dropout were used to represent increased IP and were either present or absent in each image. For each image, the diagnostic accuracy, confidence, and quality were assessed. Results Diagnostic accuracy was significantly higher for experienced analysts compared with inexperienced analysts from the first set (96.7% vs 83.1%, P  < .001) to the third set (95% vs 89.7, P  = .127). No differences in accuracy were noted between inexperienced analysts and pathologists. Confidence (odds ratio, 8.71; 95% confidence interval, 5.58-13.57) and good image quality (odds ratio, 1.58; 95% confidence interval, 1.22-2.03) were associated with improved interpretation. Interobserver agreement κ values were high and improved with experience (experienced analysts, 0.83; inexperienced analysts, 0.73; and pathologists, 0.62). Intraobserver agreement was >0.86 for experienced observers. Conclusion Features representative of increased IP can be rapidly learned with high inter- and intraobserver agreement. Confidence and image quality were significant predictors of accurate interpretation. Previous pathology training did not have an effect on learning.