Is ChatGPT‐4 Accurate in Proofread a Manuscript in Otolaryngology–Head and Neck Surgery?

ChatGPT is a new artificial intelligence‐powered language model of chatbot able to help otolaryngologists in clinical practice and research. We investigated the ability of ChatGPT‐4 in the editing of a manuscript in otolaryngology. Four papers were written by a nonnative English otolaryngologist and...

Full description

Saved in:
Bibliographic Details
Published in:Otolaryngology-head and neck surgery 2024-06, Vol.170 (6), p.1527-1530
Main Authors: Lechien, Jerome R., Gorton, Amy, Robertson, Jean, Vaira, Luigi A.
Format: Article
Language:English
Subjects:
artificial
Artificial Intelligence
ChatGPT‐4
correction
GPT‐4
head neck
Humans
intelligence
Life Sciences
Otolaryngology
proofread
scientific
surgery
Writing
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:ChatGPT is a new artificial intelligence‐powered language model of chatbot able to help otolaryngologists in clinical practice and research. We investigated the ability of ChatGPT‐4 in the editing of a manuscript in otolaryngology. Four papers were written by a nonnative English otolaryngologist and edited by a professional editing service. ChatGPT‐4 was used to detect and correct errors in manuscripts. From the 171 errors in the manuscripts, ChatGPT‐4 detected 86 errors (50.3%) including vocabulary (N = 36), determiner (N = 27), preposition (N = 24), capitalization (N = 20), and number (N = 11). ChatGPT‐4 proposed appropriate corrections for 72 (83.7%) errors, while some errors were poorly detected (eg, capitalization [5%] and vocabulary [44.4%] errors. ChatGPT‐4 claimed to change something that was already there in 82 cases. ChatGPT demonstrated usefulness in identifying some types of errors but not all. Nonnative English researchers should be aware of the current limits of ChatGPT‐4 in the proofreading of manuscripts.
ISSN:0194-5998
1097-6817
DOI:10.1002/ohn.526