Creation and validation of a chest X-ray dataset with eye-tracking and report dictation for AI development

We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye-tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radi...

Full description

Saved in:
Bibliographic Details
Published in:Scientific data 2021-03, Vol.8 (1), p.92-92, Article 92
Main Authors: Karargyris, Alexandros, Kashyap, Satyananda, Lourentzou, Ismini, Wu, Joy T., Sharma, Arjun, Tong, Matthew, Abedin, Shafiq, Beymer, David, Mukherjee, Vandana, Krupinski, Elizabeth A., Moradi, Mehdi
Format: Article
Language:English
Subjects:
639/705/117
692/700/139
Artificial intelligence
Chest
Data Descriptor
Datasets
Deep Learning
Humanities and Social Sciences
Humans
Learning algorithms
Localization
Machine learning
multidisciplinary
Radiography
Radiology
Science
Science (multidisciplinary)
Thorax - diagnostic imaging
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye-tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist’s dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning/machine learning methods. Furthermore, investigators in disease classification and localization, automated radiology report generation, and human-machine interaction can benefit from these data. We report deep learning experiments that utilize the attention maps produced by the eye gaze dataset to show the potential utility of this dataset. Measurement(s) chest X-ray image • radiologist’s dictation audio data • radiologist’s eye gaze coordinates data Technology Type(s) eye tracking device • machine learning • Radiologist • Chest Radiography Sample Characteristic - Organism Homo sapiens Machine-accessible metadata file describing the reported data: https://doi.org/10.6084/m9.figshare.14035613
ISSN:2052-4463
2052-4463
DOI:10.1038/s41597-021-00863-5