Mitigating Bias in Radiology Machine Learning: 1. Data Handling

Minimizing bias is critical to adoption and implementation of machine learning (ML) in clinical practice. Systematic mathematical biases produce consistent and reproducible differences between the observed and expected performance of ML systems, resulting in suboptimal performance. Such biases can b...

Full description

Saved in:
Bibliographic Details
Published in:Radiology. Artificial intelligence 2022-09, Vol.4 (5), p.e210290
Main Authors: Rouzrokh, Pouria, Khosravi, Bardia, Faghani, Shahriar, Moassefi, Mana, Vera Garcia, Diana V, Singh, Yashbir, Zhang, Kuan, Conte, Gian Marco, Erickson, Bradley J
Format: Article
Language:English
Subjects:
Special Report
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Minimizing bias is critical to adoption and implementation of machine learning (ML) in clinical practice. Systematic mathematical biases produce consistent and reproducible differences between the observed and expected performance of ML systems, resulting in suboptimal performance. Such biases can be traced back to various phases of ML development: data handling, model development, and performance evaluation. This report presents 12 suboptimal practices during data handling of an ML study, explains how those practices can lead to biases, and describes what may be done to mitigate them. Authors employ an arbitrary and simplified framework that splits ML data handling into four steps: data collection, data investigation, data splitting, and feature engineering. Examples from the available research literature are provided. A Google Colaboratory Jupyter notebook includes code examples to demonstrate the suboptimal practices and steps to prevent them. Data Handling, Bias, Machine Learning, Deep Learning, Convolutional Neural Network (CNN), Computer-aided Diagnosis (CAD) © RSNA, 2022.
ISSN:2638-6100
2638-6100
DOI:10.1148/ryai.210290