Evaluation framework for carotid bifurcation lumen segmentation and stenosis grading

• Published in: Medical image analysis 2011-08, Vol.15 (4), p.477-488
• Main Authors: Hameeteman, K., Zuluaga, M.A., Freiman, M., Joskowicz, L., Cuisenaire, O., Valencia, L. Flórez, Gülsün, M.A., Krissian, K., Mille, J., Wong, W.C.K., Orkisz, M., Tek, H., Hoyos, M. Hernández, Benmansour, F., Chung, A.C.S., Rozie, S., van Gils, M., van den Borne, L., Sosna, J., Berman, P., Cohen, N., Douek, P.C., Sánchez, I., Aissat, M., Schaap, M., Metz, C.T., Krestin, G.P., van der Lugt, A., Niessen, W.J., van Walsum, T.
• Format: Article
• Language: English
• Subjects: Algorithms; Angiography - methods; Carotid; Carotid Arteries - diagnostic imaging; Carotid Stenosis - diagnostic imaging; Computer Science; CTA; Engineering Sciences; Evaluation framework; Humans; Imaging, Three-Dimensional - methods; Lumen segmentation; Medical Imaging; Pattern Recognition, Automated - methods; Radiographic Image Enhancement - methods; Radiographic Image Interpretation, Computer-Assisted - methods; Reproducibility of Results; Sensitivity and Specificity; Signal and Image Processing; Stenosis grading; Tomography, X-Ray Computed - methods
• ISSN: 1361-8415; 1361-8423
• DOI: 10.1016/j.media.2011.02.004

This paper describes an evaluation framework that allows a standardized and objective quantitative comparison of carotid artery lumen segmentation and stenosis grading algorithms. We describe the data repository comprising 56 multi-center, multi-vendor CTA datasets, their acquisition, the creation of the reference standard and the evaluation measures. This framework has been introduced at the MICCAI 2009 workshop 3D Segmentation in the Clinic: A Grand Challenge III, and we compare the results of eight teams that participated. These results show that automated segmentation of the vessel lumen is possible with a precision that is comparable to manual annotation. The framework is open for new submissions through the website http://cls2009.bigr.nl. [Display omitted] ► Evaluation framework for carotid artery lumen segmentation and stenosis grading. ► Description of the datasets and creation of reference standard is given. ► Standardized evaluation measures are defined. ► Results on current eight submissions are presented. ► Framework is open for new submissions. This paper describes an evaluation framework that allows a standardized and objective quantitative comparison of carotid artery lumen segmentation and stenosis grading algorithms. We describe the data repository comprising 56 multi-center, multi-vendor CTA datasets, their acquisition, the creation of the reference standard and the evaluation measures. This framework has been introduced at the MICCAI 2009 workshop 3D Segmentation in the Clinic: A Grand Challenge III, and we compare the results of eight teams that participated. These results show that automated segmentation of the vessel lumen is possible with a precision that is comparable to manual annotation. The framework is open for new submissions through the website http://cls2009.bigr.nl.