Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathology

The interactions between tumor cells and the tumor microenvironment (TME) dictate therapeutic efficacy of radiation and many systemic therapies in breast cancer. However, to date, there is not a widely available method to reproducibly measure tumor and immune phenotypes for each patient's tumor...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-04
Main Authors: Gonçalves, Tiago, Pulido-Arias, Dagoberto, Willett, Julian, Hoebel, Katharina V, Mason, Cleveland, Ahmed, Syed Rakin, Gerstner, Elizabeth, Kalpathy-Cramer, Jayashree, Cardoso, Jaime S, Bridge, Christopher P, Kim, Albert E
Format: Article
Language:English
Subjects:
Algorithms
Biomarkers
Breast cancer
Deep learning
Feature extraction
Gene expression
Machine learning
Tumors
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The interactions between tumor cells and the tumor microenvironment (TME) dictate therapeutic efficacy of radiation and many systemic therapies in breast cancer. However, to date, there is not a widely available method to reproducibly measure tumor and immune phenotypes for each patient's tumor. Given this unmet clinical need, we applied multiple instance learning (MIL) algorithms to assess activity of ten biologically relevant pathways from the hematoxylin and eosin (H&E) slide of primary breast tumors. We employed different feature extraction approaches and state-of-the-art model architectures. Using binary classification, our models attained area under the receiver operating characteristic (AUROC) scores above 0.70 for nearly all gene expression pathways and on some cases, exceeded 0.80. Attention maps suggest that our trained models recognize biologically relevant spatial patterns of cell sub-populations from H&E. These efforts represent a first step towards developing computational H&E biomarkers that reflect facets of the TME and hold promise for augmenting precision oncology.
ISSN:2331-8422