Deep learning–based pancreas segmentation and station recognition system in EUS: development and validation of a useful training tool (with video)

• Published in: Gastrointestinal endoscopy 2020-10, Vol.92 (4), p.874-885.e3
• Main Authors: Zhang, Jun, Zhu, Liangru, Yao, Liwen, Ding, Xiangwu, Chen, Di, Wu, Huiling, Lu, Zihua, Zhou, Wei, Zhang, Lihui, An, Ping, Xu, Bo, Tan, Wei, Hu, Shan, Cheng, Fan, Yu, Honggang
• Format: Article
• Language: English
• Subjects: Cross-Over Studies; Deep Learning; Humans; Learning Curve; Pancreas - diagnostic imaging; Ultrasonography
• ISSN: 0016-5107; 1097-6779
• DOI: 10.1016/j.gie.2020.04.071

EUS is considered one of the most sensitive modalities for pancreatic cancer detection, but it is highly operator-dependent and the learning curve is steep. In this study, we constructed a system named BP MASTER (pancreaticobiliary master) for EUS training and quality control. The standard procedure of pancreatic EUS was divided into 6 stations. We developed a station classification model and a pancreas/abdominal aorta/portal confluence segmentation model with 19,486 images and 2207 images, respectively. Then, we used 1920 images and 700 images for classification and segmentation internal validation, respectively. To test station recognition we used 396 videos clips. An independent data set containing 180 images was applied for comparing the performance between models and EUS experts. Seven hundred sixty-eight images from 2 other hospitals were used for external validation. A crossover study was conducted to test the system effect on reducing difficulty in ultrasonographics interpretation among trainees. The models achieved 94.2% accuracy in station classification and .836 dice in segmentation at internal validation. At external validation, the models achieved 82.4% accuracy in station classification and .715 dice in segmentation. For the video test, the station classification model achieved a per-frame accuracy of 86.2%. Compared with EUS experts, the models achieved 90.0% accuracy in classification and .77 and .813 dice in blood vessel and pancreas segmentation, which is comparable with that of experts. In the crossover study, trainee station recognition accuracy improved from 67.2% to 78.4% (95% confidence interval, .058-1.663; P < .01). The BP MASTER system has the potential to play an important role in shortening the pancreatic EUS learning curve and improving EUS quality control in the future. [Display omitted]