Should AI models be explainable to clinicians?

In the high-stakes realm of critical care, where daily decisions are crucial and clear communication is paramount, comprehending the rationale behind Artificial Intelligence (AI)-driven decisions appears essential. While AI has the potential to improve decision-making, its complexity can hinder comp...

Full description

Saved in:
Bibliographic Details
Published in:Critical care (London, England) England), 2024-09, Vol.28 (1), p.301, Article 301
Main Authors: Abgrall, Gwénolé, Holder, Andre L, Chelly Dagdia, Zaineb, Zeitouni, Karine, Monnet, Xavier
Format: Article
Language:English
Subjects:
Artificial intelligence
Artificial Intelligence - standards
Artificial Intelligence - trends
Clinical Decision-Making - methods
Computer Science
Critical Care - methods
Critical Care - standards
Debate
Decision-making
Humans
Life Sciences
Physicians - standards
Statistics
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the high-stakes realm of critical care, where daily decisions are crucial and clear communication is paramount, comprehending the rationale behind Artificial Intelligence (AI)-driven decisions appears essential. While AI has the potential to improve decision-making, its complexity can hinder comprehension and adherence to its recommendations. "Explainable AI" (XAI) aims to bridge this gap, enhancing confidence among patients and doctors. It also helps to meet regulatory transparency requirements, offers actionable insights, and promotes fairness and safety. Yet, defining explainability and standardising assessments are ongoing challenges and balancing performance and explainability can be needed, even if XAI is a growing field.
ISSN:1364-8535
1466-609X
1466-609X
1364-8535
DOI:10.1186/s13054-024-05005-y