Contour-aware network with class-wise convolutions for 3D abdominal multi-organ segmentation

• Published in: Medical image analysis 2023-07, Vol.87, p.102838-102838, Article 102838
• Main Authors: Gao, Hongjian, Lyu, Mengyao, Zhao, Xinyue, Yang, Fan, Bai, Xiangzhi
• Format: Article
• Language: English
• Subjects: CT image; Deep learning; Image segmentation; Three-dimensional organ segmentation
• ISSN: 1361-8415; 1361-8423
• DOI: 10.1016/j.media.2023.102838

Accurate delineation of multiple organs is a critical process for various medical procedures, which could be operator-dependent and time-consuming. Existing organ segmentation methods, which were mainly inspired by natural image analysis techniques, might not fully exploit the traits of the multi-organ segmentation task and could not accurately segment the organs with various shapes and sizes simultaneously. In this work, the characteristics of multi-organ segmentation are considered: the global count, position and scale of organs are generally predictable, while their local shape and appearance are volatile. Thus, we supplement the region segmentation backbone with a contour localization task to increase the certainty along delicate boundaries. Meantime, each organ has exclusive anatomical traits, which motivates us to deal with class variability with class-wise convolutions to highlight organ-specific features and suppress irrelevant responses at different field-of-views. To validate our method with adequate amounts of patients and organs, we constructed a multi-center dataset, which contains 110 3D CT scans with 24,528 axial slices, and provided voxel-level manual segmentations of 14 abdominal organs, which adds up to 1,532 3D structures in total. Extensive ablation and visualization studies on it validate the effectiveness of the proposed method. Quantitative analysis shows that we achieve state-of-the-art performance for most abdominal organs, and obtain 3.63 mm 95% Hausdorff Distance and 83.32% Dice Similarity Coefficient on an average. •Proposed a novel contour-aware network with class-wise operations.•Increased the certainty along delicate boundaries with a contour localization task.•Designed MuSeCWA module and CWASPP module to deal with class variability.•Built a dataset including 24528 CT slices with manual labels of 14 abdominal organs.