Polyp-E: Benchmarking the Robustness of Deep Segmentation Models via Polyp Editing

Automatic polyp segmentation is helpful to assist clinical diagnosis and treatment. In daily clinical practice, clinicians exhibit robustness in identifying polyps with both location and size variations. It is uncertain if deep segmentation models can achieve comparable robustness in automated colon...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-10
Main Authors: Runpu Wei, Yin, Zijin, Liang, Kongming, Min, Min, Pan, Chengwei, Yu, Gang, Huang, Haonan, Liu, Yan, Ma, Zhanyu
Format: Article
Language:English
Subjects:
Benchmarks
Data augmentation
Datasets
Editing
Polyps
Robustness
Segmentation
Synthetic data
Uncertainty analysis
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automatic polyp segmentation is helpful to assist clinical diagnosis and treatment. In daily clinical practice, clinicians exhibit robustness in identifying polyps with both location and size variations. It is uncertain if deep segmentation models can achieve comparable robustness in automated colonoscopic analysis. To benchmark the model robustness, we focus on evaluating the robustness of segmentation models on the polyps with various attributes (e.g. location and size) and healthy samples. Based on the Latent Diffusion Model, we perform attribute editing on real polyps and build a new dataset named Polyp-E. Our synthetic dataset boasts exceptional realism, to the extent that clinical experts find it challenging to discern them from real data. We evaluate several existing polyp segmentation models on the proposed benchmark. The results reveal most of the models are highly sensitive to attribute variations. As a novel data augmentation technique, the proposed editing pipeline can improve both in-distribution and out-of-distribution generalization ability. The code and datasets will be released.
ISSN:2331-8422