Enhancing detection of various pancreatic lesions on endoscopic ultrasound through artificial intelligence: a basis for computer-aided detection systems

• Published in: Journal of gastroenterology and hepatology 2024-11
• Main Authors: Konikoff, Tom, Loebl, Nadav, Benson, Ariel A, Green, Orr, Sandler, Hunter, Gingold-Belfer, Rachel, Levi, Zohar, Perl, Leor, Dotan, Iris, Shamah, Steven
• Format: Article
• Language: English
• ISSN: 0815-9319; 1440-1746; 1440-1746
• DOI: 10.1111/jgh.16814

Endoscopic ultrasound (EUS) is the most sensitive method for evaluation of pancreatic lesions but is limited by significant operator dependency. Artificial intelligence (AI), in the form of computer-aided detection (CADe) systems, has shown potential in increasing accuracy and bridging operator dependency in several endoscopic domains. However, the complexity of integrating AI into EUS is far more challenging. This aims to develop and test the basis for a CADe system for real-time detection and segmentation of all pancreatic lesions. In this single-center study EUS studies of pancreatic findings were included. Lesions were outlined by two expert (>5 years performing EUS) endoscopists, and the two leading types of models were benchmarked. The models' performance was evaluated through per-pixel intersection over union (IoU). A total of 1497 EUS images from 165 patients were evaluated. The dataset included malignancies, neuroendocrine tumors, benign cysts, chronic and acute pancreatitis, normal fatty pancreas, and benign lesions. The best model demonstrated detection and segmentation on the test set with a mean IoU of 0.73, achieving a PPV, NPV, total accuracy, and ROC of 0.82, 0.96, 0.95, and 0.95, respectively. The algorithm is adaptable for real-time processing. We developed and tested deep learning models for real-time detection and segmentation of pancreatic lesions during EUS with promising results. This constitutes the basis for a CADe system for EUS, which could be valuable in future detection and evaluation of pancreatic lesions. Further studies for validation and generalization are underway.