Diagnosis, treatment, and prevention of ankle sprains: Comparing free chatbot recommendations with clinical guidelines

Free chatbots powered by large language models offer lateral ankle sprains (LAS) treatment recommendations but lack scientific validation. The chatbots—Claude, Perplexity, and ChatGPT—were evaluated by comparing their responses to a questionnaire and their treatment algorithms against current clinic...

Full description

Saved in:
Bibliographic Details
Published in:Foot and ankle surgery 2024-12
Main Authors: Roch, Friederike Eva, Hahn, Franziska Melanie, Jäckle, Katharina, Meier, Marc-Pascal, Stinus, Hartmut, Lehmann, Wolfgang, Perthel, Ronny, Roch, Paul Jonathan
Format: Article
Language:English
Subjects:
artificial intelligence (AI)
chatbots
ChatGPT
Claude
Lateral ankle sprains
Perplexity
treatment recommendations
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Free chatbots powered by large language models offer lateral ankle sprains (LAS) treatment recommendations but lack scientific validation. The chatbots—Claude, Perplexity, and ChatGPT—were evaluated by comparing their responses to a questionnaire and their treatment algorithms against current clinical guidelines. Responses were graded on accuracy, conclusiveness, supplementary information, and incompleteness, and evaluated individually and collectively, with a 60 % pass threshold. The collective analysis of the questionnaire showed Perplexity scored significantly higher than Claude and ChatGPT (p 
ISSN:1268-7731
1460-9584
1460-9584
DOI:10.1016/j.fas.2024.12.003