Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study

: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. : ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all...

Full description

Saved in:
Bibliographic Details
Published in:Journal of clinical medicine 2024-01, Vol.13 (3), p.735
Main Authors: Hatia, Arjeta, Doldo, Tiziana, Parrini, Stefano, Chisci, Elettra, Cipriani, Linda, Montagna, Livia, Lagana, Giuseppina, Guenza, Guia, Agosta, Edoardo, Vinjolli, Franceska, Hoxha, Meladiona, D'Amelio, Claudio, Favaretto, Nicolò, Chisci, Glauco
Format: Article
Language:English
Subjects:
Accuracy
Artificial intelligence
Chatbots
Collaboration
Ethics
Health aspects
Medical research
Orthodontics
Patients
Practice
Researchers
Software
Students
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. : ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1-6) and completeness (range 1-3) Likert scales. : For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases. : The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.
ISSN:2077-0383
2077-0383
DOI:10.3390/jcm13030735