Multicenter randomized comparative trial of Micromedex, Micromedex with Watson, or Google to answer drug information questions

• Published in: Journal of the Medical Library Association 2021-04, Vol.109 (2), p.212-218
• Main Authors: Giuliano, Christopher, McConachie, Sean, Kalabalik-Hoganson, Julie
• Format: Article
• Language: English
• Subjects: Age; Comparative analysis; Decision making; Drug dosages; Drug stores; Evaluation; Health sciences; Information sources; Information storage; information storage and retrieval; internet; Internet resources; Librarians; medical informatics; Medical students; Online health care information services; Original Investigation; Pharmacists; Pharmacy; pharmacy student; Questionnaires; Search engines; Search strategies; Standard deviation; Study and teaching; Variance analysis
• ISSN: 1536-5050; 1558-9439
• DOI: 10.5195/jmla.2021.1085

Objective: The purpose of this study was to compare pharmacy students' ability to correctly answer drug information questions using Micromedex with Watson, Micromedex without Watson, or Google. Methods: This multicenter randomized trial compared pharmacy student responses to drug information questions using Micromedex with Watson, Micromedex without Watson, or Google from January to March of 2020. First- to fourth-year pharmacy students at two institutions were included. The primary outcome was the number of correct answers. Secondary outcomes were the time taken to answer the questions and differences in number of correct answers by pharmacy student year and institution. Results: The analysis included 162 participants: 52 students in the Micromedex group, 51 students in the Watson group, and 59 students in the Google group. There was a significant difference among groups in the total number of questions answered correctly (p=0.02). Post-hoc analysis revealed that participants in the Micromedex group answered more questions correctly than those in the Google group (p=0.015). There were no significant differences between Micromedex and Watson groups (p=0.52) or between Watson and Google groups (p=0.22). There was also no difference in time to complete the questions among groups (p=0.72). Conclusion: Utilizing Google did not save students time and led to more incorrect answers. These findings suggest that health care educators and health sciences librarians should further reinforce training on the appropriate use of drug information resources. Keywords: information storage and retrieval; internet; medical informatics; pharmacy student