3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology

The increasing use of medical imaging in healthcare settings presents a significant challenge due to the increasing workload for radiologists, yet it also offers opportunity for enhancing healthcare outcomes if effectively leveraged. 3D image retrieval holds potential to reduce radiologist workloads...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-11
Main Authors: Asma Ben Abacha, Santamaria-Pang, Alberto, Lee, Ho Hin, Jameson Merkow, Cai, Qin, Devarakonda, Surya Teja, Islam, Abdullah, Gong, Julia, Lungren, Matthew P, Lin, Thomas, Codella, Noel C, Tarapov, Ivan
Format: Article
Language:English
Subjects:
Benchmarks
Computed tomography
Datasets
Health care
Image enhancement
Image retrieval
Medical electronics
Medical imaging
Search methods
Workload
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The increasing use of medical imaging in healthcare settings presents a significant challenge due to the increasing workload for radiologists, yet it also offers opportunity for enhancing healthcare outcomes if effectively leveraged. 3D image retrieval holds potential to reduce radiologist workloads by enabling clinicians to efficiently search through diagnostically similar or otherwise relevant cases, resulting in faster and more precise diagnoses. However, the field of 3D medical image retrieval is still emerging, lacking established evaluation benchmarks, comprehensive datasets, and thorough studies. This paper attempts to bridge this gap by introducing a novel benchmark for 3D Medical Image Retrieval (3D-MIR) that encompasses four different anatomies imaged with computed tomography. Using this benchmark, we explore a diverse set of search strategies that use aggregated 2D slices, 3D volumes, and multi-modal embeddings from popular multi-modal foundation models as queries. Quantitative and qualitative assessments of each approach are provided alongside an in-depth discussion that offers insight for future research. To promote the advancement of this field, our benchmark, dataset, and code are made publicly available.
ISSN:2331-8422