The use of artificial intelligence based chat bots in ophthalmology triage

To evaluate AI-based chat bots ability to accurately answer common patient's questions in the field of ophthalmology. An experienced ophthalmologist curated a set of 20 representative questions and responses were sought from two AI generative models: OpenAI's ChatGPT and Google's Bard...

Full description

Saved in:
Bibliographic Details
Published in:Eye (London) 2024-11
Main Authors: David, Daniel, Zloto, Ofira, Katz, Gabriel, Huna-Baron, Ruth, Vishnevskia-Dai, Vicktoria, Armarnik, Sharon, Zauberman, Noa Avni, Barnir, Elinor Megiddo, Singer, Reut, Hostovsky, Avner, Klang, Eyal
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To evaluate AI-based chat bots ability to accurately answer common patient's questions in the field of ophthalmology. An experienced ophthalmologist curated a set of 20 representative questions and responses were sought from two AI generative models: OpenAI's ChatGPT and Google's Bard (Gemini Pro). Eight expert ophthalmologists from different sub-specialties assessed each response, blinded to the source, and ranked them by three metrics-accuracy, comprehensiveness, and clarity, on a 1-5 scale. For accuracy, ChatGPT scored a median of 4.0, whereas Bard scored a median of 3.0. In terms of comprehensiveness, ChatGPT achieved a median score of 4.5, compared to Bard which scored a median of 3.0. Regarding clarity, ChatGPT maintained a higher score with a median of 5.0, compared to Bard's median score of 4.0. All comparisons were statistically significant (p 
ISSN:0950-222X
1476-5454
1476-5454
DOI:10.1038/s41433-024-03488-1