The impact of internet resources and artificial intelligence on information on myringotomy tubes

• Published in: European archives of oto-rhino-laryngology 2024-12
• Main Authors: Papuc, Melissa, Scheffler, Patrick
• Format: Article
• Language: English
• ISSN: 0937-4477; 1434-4726; 1434-4726
• DOI: 10.1007/s00405-024-09148-0

To compare the quality and readability of patient education materials on myringotomy tubes from artificial intelligence and Google search. Three questions were posed to ChatGPT and Google Gemini addressing "Condition," "Investigation," and "Treatment" domains. Google was queried for "Ear tubes," "Myringotomy and tubes," and "Tympanostomy tubes." Text quality was assessed using the DISCERN instrument. Readability was assessed using the Flesch-Kincaid Grade Level, Flesch-Kincaid Reading Ease scores, and the Fry Readability Graph. The average DISCERN score for websites was 52 (SD = 13.1, Median = 55.5), out of 80. The mean Flesch-Kincaid Reading Grade Level was 8 (SD = 3, Median = 7.1), and the mean Flesch-Kincaid Reading Ease score was 55 (SD = 12.3, Median = 57.7). ChatGPT and Google Gemini's "Condition" responses each had DISCERN scores of 46, Flesch-Kincaid Grade Levels of 13.1 and 9.5, and Reading Ease scores of 41 and 61. For "Investigation," DISCERN scores were 46 (ChatGPT) and 66 (Google Gemini), Grade Levels were 13.9 and 12.4, and Reading Ease scores were 38.9 and 34.9. For "Treatment," ChatGPT and Google Gemini had DISCERN scores of 45 and 34, Grade Levels of 15.7 and 9.8, and Reading Ease scores of 36.2 and 53.9. Sites and artificial intelligence providing patient education material regarding myringotomy tubes are of "fair" quality but have readability levels above the recommended 6th grade level. Google search results were superior to artificial intelligence in readability.