Multiple systematic reviews: methods for assessing discordances of results

• Published in: Internal and emergency medicine 2012-12, Vol.7 (6), p.563-568
• Main Authors: Moja, Lorenzo, Fernandez del Rio, M. Pilar, Banzi, Rita, Cusi, Cristina, D’Amico, Roberto, Liberati, Alessandro, Lodi, Giovanni, Lucenteforte, Ersilia, Minozzi, Silvia, Pecoraro, Valentina, Virgili, Gianni, Parmelli, Elena
• Format: Article
• Language: English
• Subjects: CE - Cochrane Clinical Evidence and Health Technology Assessment; Humans; Internal Medicine; Medicine; Medicine & Public Health; Reproducibility of Results; Research Design; Review Literature as Topic
• ISSN: 1828-0447; 1970-9366
• DOI: 10.1007/s11739-012-0846-1

Abtract Background The process of systematically reviewing research evidence is useful for collecting, assessing and summarizing results from multiple studies planned to answer the same clinical question. The term “systematic” implies that the process, besides being organized and complete, is transparent and fully reported to allow other independent researchers to replicate the results, and therefore come to the same conclusions. Hundreds of new systematic reviews are indexed every year. The growing number increases the likelihood of finding multiple and discordant results. Objectives To clarify the impact of multiple and discordant systematic reviews, we designed a program aimed at finding out: (a) how often different systematic reviews are done on the same subject; (b) how often different systematic reviews on the same topic give different results or conclusions; (c) which methods or interpretation characteristics can explain the differences in results or conclusions. Methods This paper outlines the method used to explore the frequency and the causes of discordance among multiple systematic reviews on the same topic. These methods were then applied to a few medical fields as case studies. Conclusion This aim is particularly relevant for both clinicians and policy makers. Judgments about evidence and recommendation in health care are complex, and often rely on discordant results, especially when there are no empirical results to help serve as a guideline.