Assessing the utility of artificial intelligence throughout the triage outpatients: a prospective randomized controlled clinical study

• Published in: Frontiers in public health 2024-05, Vol.12, p.1391906
• Main Authors: Liu, Xiaoni, Lai, Rui, Wu, Chaoling, Yan, Changjian, Gan, Zhe, Yang, Yaru, Zeng, Xiangtai, Liu, Jin, Liao, Liangliang, Lin, Yuansheng, Jing, Hongmei, Zhang, Weilong
• Format: Article
• Language: English
• Subjects: Adult; Aged; Artificial Intelligence; ChatGPT; Female; Humans; Male; Middle Aged; Natural Language Processing; Outpatients - statistics & numerical data; Prospective Studies; Public Health; Triage; triage outpatients
• ISSN: 2296-2565; 2296-2565
• DOI: 10.3389/fpubh.2024.1391906

Currently, there are still many patients who require outpatient triage assistance. ChatGPT, a natural language processing tool powered by artificial intelligence technology, is increasingly utilized in medicine. To facilitate and expedite patients' navigation to the appropriate department, we conducted an outpatient triage evaluation of ChatGPT. For this evaluation, we posed 30 highly representative and common outpatient questions to ChatGPT and scored its responses using a panel of five experienced doctors. The consistency of manual triage and ChatGPT triage was assessed by five experienced doctors, and statistical analysis was performed using the Chi-square test. The expert ratings of ChatGPT's answers to these 30 frequently asked questions revealed 17 responses earning very high scores (10 and 9.5 points), 7 earning high scores (9 points), and 6 receiving low scores (8 and 7 points). Additionally, we conducted a prospective cohort study in which 45 patients completed forms detailing gender, age, and symptoms. Triage was then performed by outpatient triage staff and ChatGPT. Among the 45 patients, we found a high level of agreement between manual triage and ChatGPT triage (consistency: 93.3-100%,