A New Framework to Reduce Doctor's Workload for Medical Image Annotation

• Published in: IEEE access 2019, Vol.7, p.107097-107104
• Main Authors: Deng, Yang, Sun, Yao, Zhu, Yongpei, Xu, Yue, Yang, Qianxi, Zhang, Shuo, Wang, Zhanyu, Sun, Jirang, Zhao, Weiling, Zhou, Xiaobo, Yuan, Kehong
• Format: Article
• Language: English
• Subjects: Active learning; annotation workload; Annotations; Artificial intelligence; Candidates; Cerebrospinal fluid; fine annotation; Image annotation; Image segmentation; Learning; Medical diagnostic imaging; Medical image annotation; Medical imaging; Medical services; Physicians; Training data; Uncertainty; Workload; Workloads
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2019.2917932

Accurate annotation of the medical image is the crucial step for image artificial intelligence (AI) clinical application. However, annotating medical image will incur a lot of annotation efforts and expense due to its high complexity and needing experienced doctors. In order to reduce the cost of annotation, several active learning methods have been proposed previously. However, the focus of these methods is to reduce the number of annotation candidates with little regard for doctor's workload, which is not enough for medical image annotation, since even annotating a small amount of data will take a lot of time for doctors. In order to effectively reduce the workload of doctors, we developed a new framework for medical image annotation. First, by combining active learning and U-shape network, we employed a suggestive annotation strategy to select the most effective annotation candidates. We then exploited a fine annotation platform to alleviate annotating efforts on each candidate and utilized a new criterion to quantitatively calculate the efforts of doctors. In this paper, we used MR brain tissue segmentation as an example to evaluate the proposed method. The extensive experiments with the IBSR18 and MRBrainS18 Challenge datasets showed that with the proposed strategy, only 60% of the annotation candidates were needed to achieve the most advanced segmentation performance, and the annotation workload of doctors can be alleviated by at least 44%, 44%, and 47% on cerebrospinal fluid (CSF), gray matter (GM), and white matter (WM), respectively. Meanwhile, our proposed method was proven to be effective for annotation of clinical data collected from our hospital, where the annotation workload of doctors was alleviated by at least 32% on WM and the time of annotating each clinical candidate is expected to be saved by at least 64%.