Artificial intelligence in systematic reviews: promising when appropriately used

BackgroundSystematic reviews provide a structured overview of the available evidence in medical-scientific research. However, due to the increasing medical-scientific research output, it is a time-consuming task to conduct systematic reviews. To accelerate this process, artificial intelligence (AI)...

Full description

Saved in:
Bibliographic Details
Published in:BMJ open 2023-07, Vol.13 (7), p.e072254-e072254
Main Authors: van Dijk, Sanne H B, Brusse-Keizer, Marjolein G J, Bucsán, Charlotte C, van der Palen, Job, Doggen, Carine J M, Lenferink, Anke
Format: Article
Language:English
Subjects:
Algorithms
Artificial intelligence
Citation management software
Communication
Decision making
information technology
Medical research
statistics & research methods
Systematic review
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:BackgroundSystematic reviews provide a structured overview of the available evidence in medical-scientific research. However, due to the increasing medical-scientific research output, it is a time-consuming task to conduct systematic reviews. To accelerate this process, artificial intelligence (AI) can be used in the review process. In this communication paper, we suggest how to conduct a transparent and reliable systematic review using the AI tool ‘ASReview’ in the title and abstract screening.MethodsUse of the AI tool consisted of several steps. First, the tool required training of its algorithm with several prelabelled articles prior to screening. Next, using a researcher-in-the-loop algorithm, the AI tool proposed the article with the highest probability of being relevant. The reviewer then decided on relevancy of each article proposed. This process was continued until the stopping criterion was reached. All articles labelled relevant by the reviewer were screened on full text.ResultsConsiderations to ensure methodological quality when using AI in systematic reviews included: the choice of whether to use AI, the need of both deduplication and checking for inter-reviewer agreement, how to choose a stopping criterion and the quality of reporting. Using the tool in our review resulted in much time saved: only 23% of the articles were assessed by the reviewer.ConclusionThe AI tool is a promising innovation for the current systematic reviewing practice, as long as it is appropriately used and methodological quality can be assured.PROSPERO registration numberCRD42022283952.
ISSN:2044-6055
2044-6055
DOI:10.1136/bmjopen-2023-072254