Current Progress and Challenges in Large-Scale 3D Mitochondria Instance Segmentation

• Published in: IEEE transactions on medical imaging 2023-12, Vol.42 (12), p.3956-3971
• Main Authors: Franco-Barranco, Daniel, Lin, Zudi, Jang, Won-Dong, Wang, Xueying, Shen, Qijia, Yin, Wenjie, Fan, Yutian, Li, Mingxing, Chen, Chang, Xiong, Zhiwei, Xin, Rui, Liu, Hao, Chen, Huai, Li, Zhili, Zhao, Jie, Chen, Xuejin, Pape, Constantin, Conrad, Ryan, Nightingale, Luke, de Folter, Joost, Jones, Martin L., Liu, Yanling, Ziaei, Dorsa, Huschauer, Stephan, Arganda-Carreras, Ignacio, Pfister, Hanspeter, Wei, Donglai
• Format: Article
• Language: English
• Subjects: 3D instance segmentation; Animals; Annotations; Benchmark testing; brain; Cancer; Cerebral Cortex; connectomics; Datasets; Electron microscopy; Errors; Humans; Image processing; Image Processing, Computer-Assisted - methods; Image segmentation; Instance segmentation; Measurement; Microscopy, Electron; Mitochondria; Morphology; Rats; Retrospective Studies; Teams; Three-dimensional displays
• ISSN: 0278-0062; 1558-254X; 1558-254X
• DOI: 10.1109/TMI.2023.3320497

In this paper, we present the results of the MitoEM challenge on mitochondria 3D instance segmentation from electron microscopy images, organized in conjunction with the IEEE-ISBI 2021 conference. Our benchmark dataset consists of two large-scale 3D volumes, one from human and one from rat cortex tissue, which are 1,986 times larger than previously used datasets. At the time of paper submission, 257 participants had registered for the challenge, 14 teams had submitted their results, and six teams participated in the challenge workshop. Here, we present eight top-performing approaches from the challenge participants, along with our own baseline strategies. Posterior to the challenge, annotation errors in the ground truth were corrected without altering the final ranking. Additionally, we present a retrospective evaluation of the scoring system which revealed that: 1) challenge metric was permissive with the false positive predictions; and 2) size-based grouping of instances did not correctly categorize mitochondria of interest. Thus, we propose a new scoring system that better reflects the correctness of the segmentation results. Although several of the top methods are compared favorably to our own baselines, substantial errors remain unsolved for mitochondria with challenging morphologies. Thus, the challenge remains open for submission and automatic evaluation, with all volumes available for download.