Loading…
Search strategies (filters) to identify systematic reviews in MEDLINE and Embase
Bibliographic databases provide access to an international body of scientific literature in health and medical sciences. Systematic reviews are an important source of evidence for clinicians, researchers, consumers, and policymakers as they address a specific health-related question and use explicit...
Saved in:
Published in: | Cochrane database of systematic reviews 2023-09, Vol.9 (9), p.MR000054 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | 9 |
container_start_page | MR000054 |
container_title | Cochrane database of systematic reviews |
container_volume | 9 |
creator | Escobar Liquitay, Camila Micaela Garegnani, Luis Garrote, Virginia Solà, Ivan Franco, Juan Va |
description | Bibliographic databases provide access to an international body of scientific literature in health and medical sciences. Systematic reviews are an important source of evidence for clinicians, researchers, consumers, and policymakers as they address a specific health-related question and use explicit methods to identify, appraise and synthesize evidence from which conclusions can be drawn and decisions made. Methodological search filters help database end-users search the literature effectively with different levels of sensitivity and specificity. These filters have been developed for various study designs and have been found to be particularly useful for intervention studies. Other filters have been developed for finding systematic reviews. Considering the variety and number of available search filters for systematic reviews, there is a need for a review of them in order to provide evidence about their retrieval properties at the time they were developed.
To review systematically empirical studies that report the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE and Embase.
We searched the following databases from inception to January 2023: MEDLINE, Embase, PsycINFO; Library, Information Science & Technology Abstracts (LISTA) and Science Citation Index (Web of Science).
We included studies if one of their primary objectives is the development, evaluation, or comparison of a search filter that could be used to retrieve systematic reviews on MEDLINE, Embase, or both.
Two review authors independently extracted data using a pre-specified and piloted data extraction form using InterTASC Information Specialist Subgroup (ISSG) Search Filter Evaluation Checklist.
We identified eight studies that developed filters for MEDLINE and three studies that developed filters for Embase. Most studies are very old and some were limited to systematic reviews in specific clinical areas. Six included studies reported the sensitivity of their developed filter. Seven studies reported precision and six studies reported specificity. Only one study reported the number needed to read and positive predictive value. None of the filters were designed to differentiate systematic reviews on the basis of their methodological quality. For MEDLINE, all filters showed similar sensitivity and precision, and one filter showed higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited study |
doi_str_mv | 10.1002/14651858.MR000054.pub2 |
format | article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10485899</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2863301210</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3732-72f7a9a526b93471f798a610efd630934c732913739b85412c91063d65e6167d3</originalsourceid><addsrcrecordid>eNpVUMtOwzAQtBCIlsIvVD6WQ4ofiR2fECoBKrWAeEjcIjfZtEZ5FNst6t9jiYJgL7vaGc3sDkJDSsaUEHZBY5HQNEnH8ycSKonH682CHaB-AFQUK_52-GfuoRPn3gnhitL0GPW4FClNiOyjx2fQtlhh5632sDTg8KgytQfrzrHvsCmh9abaYbdzHhrtTYEtbA18OmxaPM-uZ9P7DOu2xFmz0A5O0VGlawdn-z5ArzfZy-Qumj3cTidXs6jgkrNIskpqpRMmForHklZSpVpQAlUpOAmrIrAUDVy1SJOYskJRIngpEhBUyJIP0OW3bvi7gbIIZ1pd52trGm13eadN_h9pzSpfdtuckjjkplRQGO0VbPexAefzxrgC6lq30G1czlLBOaGMkkAd_jX7dfnJkX8BmV11pA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2863301210</pqid></control><display><type>article</type><title>Search strategies (filters) to identify systematic reviews in MEDLINE and Embase</title><source>Alma/SFX Local Collection</source><creator>Escobar Liquitay, Camila Micaela ; Garegnani, Luis ; Garrote, Virginia ; Solà, Ivan ; Franco, Juan Va</creator><creatorcontrib>Escobar Liquitay, Camila Micaela ; Garegnani, Luis ; Garrote, Virginia ; Solà, Ivan ; Franco, Juan Va</creatorcontrib><description>Bibliographic databases provide access to an international body of scientific literature in health and medical sciences. Systematic reviews are an important source of evidence for clinicians, researchers, consumers, and policymakers as they address a specific health-related question and use explicit methods to identify, appraise and synthesize evidence from which conclusions can be drawn and decisions made. Methodological search filters help database end-users search the literature effectively with different levels of sensitivity and specificity. These filters have been developed for various study designs and have been found to be particularly useful for intervention studies. Other filters have been developed for finding systematic reviews. Considering the variety and number of available search filters for systematic reviews, there is a need for a review of them in order to provide evidence about their retrieval properties at the time they were developed.
To review systematically empirical studies that report the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE and Embase.
We searched the following databases from inception to January 2023: MEDLINE, Embase, PsycINFO; Library, Information Science & Technology Abstracts (LISTA) and Science Citation Index (Web of Science).
We included studies if one of their primary objectives is the development, evaluation, or comparison of a search filter that could be used to retrieve systematic reviews on MEDLINE, Embase, or both.
Two review authors independently extracted data using a pre-specified and piloted data extraction form using InterTASC Information Specialist Subgroup (ISSG) Search Filter Evaluation Checklist.
We identified eight studies that developed filters for MEDLINE and three studies that developed filters for Embase. Most studies are very old and some were limited to systematic reviews in specific clinical areas. Six included studies reported the sensitivity of their developed filter. Seven studies reported precision and six studies reported specificity. Only one study reported the number needed to read and positive predictive value. None of the filters were designed to differentiate systematic reviews on the basis of their methodological quality. For MEDLINE, all filters showed similar sensitivity and precision, and one filter showed higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited study reports that may affect accuracy assessments. The report of these studies had some limitations, and the assessments of their accuracy may suffer from indirectness, considering that they were mostly developed before the release of the PRISMA 2009 statement or due to their limited scope in the selection of systematic review topics. Search filters for MEDLINE Three studies produced filters with sensitivity > 90% with variable degrees of precision, and only one of them was developed and validated in a gold-standard database, which allowed the calculation of specificity. The other two search filters had lower levels of sensitivity. One of these produced a filter with higher levels of specificity (> 90%). All filters showed similar sensitivity and precision in the external validation, except for one which was not externally validated and another one which was conceptually derived and only externally validated. Search filters for Embase We identified three studies that developed filters for this database. One of these studies developed filters with variable sensitivity and precision, including highly sensitive strategies (> 90%); however, it was not externally validated. The other study produced a filter with a lower sensitivity (72.7%) but high specificity (99.1%) with a similar performance in the external validation.
Studies reporting the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE showed similar sensitivity and precision, with one filter showing higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited information about how the filter was produced, which leaves us uncertain about their performance assessments. Newer filters had limitations in their methods or scope, including very focused subject topics for their gold standards, limiting their applicability across other topics. Our findings highlight that consensus guidance on the conduct of search filters and standardized reporting of search filters are needed, as we found highly heterogeneous development methods, accuracy assessments and outcome selection. New strategies adaptable across interfaces could enhance their usability. Moreover, the performance of existing filters needs to be evaluated in light of the impact of reporting guidelines, including the PRISMA 2009, on how systematic reviews are reported. Finally, future filter developments should also consider comparing the filters against a common reference set to establish comparative performance and assess the quality of systematic reviews retrieved by strategies.</description><identifier>ISSN: 1469-493X</identifier><identifier>EISSN: 1469-493X</identifier><identifier>DOI: 10.1002/14651858.MR000054.pub2</identifier><identifier>PMID: 37681507</identifier><language>eng</language><publisher>England: John Wiley & Sons, Ltd</publisher><subject>Checklist ; Databases, Bibliographic ; Humans ; MEDLINE ; Methodology ; Systematic Reviews as Topic</subject><ispartof>Cochrane database of systematic reviews, 2023-09, Vol.9 (9), p.MR000054</ispartof><rights>Copyright © 2023 The Cochrane Collaboration. Published by John Wiley & Sons, Ltd.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,780,784,885,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37681507$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Escobar Liquitay, Camila Micaela</creatorcontrib><creatorcontrib>Garegnani, Luis</creatorcontrib><creatorcontrib>Garrote, Virginia</creatorcontrib><creatorcontrib>Solà, Ivan</creatorcontrib><creatorcontrib>Franco, Juan Va</creatorcontrib><title>Search strategies (filters) to identify systematic reviews in MEDLINE and Embase</title><title>Cochrane database of systematic reviews</title><addtitle>Cochrane Database Syst Rev</addtitle><description>Bibliographic databases provide access to an international body of scientific literature in health and medical sciences. Systematic reviews are an important source of evidence for clinicians, researchers, consumers, and policymakers as they address a specific health-related question and use explicit methods to identify, appraise and synthesize evidence from which conclusions can be drawn and decisions made. Methodological search filters help database end-users search the literature effectively with different levels of sensitivity and specificity. These filters have been developed for various study designs and have been found to be particularly useful for intervention studies. Other filters have been developed for finding systematic reviews. Considering the variety and number of available search filters for systematic reviews, there is a need for a review of them in order to provide evidence about their retrieval properties at the time they were developed.
To review systematically empirical studies that report the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE and Embase.
We searched the following databases from inception to January 2023: MEDLINE, Embase, PsycINFO; Library, Information Science & Technology Abstracts (LISTA) and Science Citation Index (Web of Science).
We included studies if one of their primary objectives is the development, evaluation, or comparison of a search filter that could be used to retrieve systematic reviews on MEDLINE, Embase, or both.
Two review authors independently extracted data using a pre-specified and piloted data extraction form using InterTASC Information Specialist Subgroup (ISSG) Search Filter Evaluation Checklist.
We identified eight studies that developed filters for MEDLINE and three studies that developed filters for Embase. Most studies are very old and some were limited to systematic reviews in specific clinical areas. Six included studies reported the sensitivity of their developed filter. Seven studies reported precision and six studies reported specificity. Only one study reported the number needed to read and positive predictive value. None of the filters were designed to differentiate systematic reviews on the basis of their methodological quality. For MEDLINE, all filters showed similar sensitivity and precision, and one filter showed higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited study reports that may affect accuracy assessments. The report of these studies had some limitations, and the assessments of their accuracy may suffer from indirectness, considering that they were mostly developed before the release of the PRISMA 2009 statement or due to their limited scope in the selection of systematic review topics. Search filters for MEDLINE Three studies produced filters with sensitivity > 90% with variable degrees of precision, and only one of them was developed and validated in a gold-standard database, which allowed the calculation of specificity. The other two search filters had lower levels of sensitivity. One of these produced a filter with higher levels of specificity (> 90%). All filters showed similar sensitivity and precision in the external validation, except for one which was not externally validated and another one which was conceptually derived and only externally validated. Search filters for Embase We identified three studies that developed filters for this database. One of these studies developed filters with variable sensitivity and precision, including highly sensitive strategies (> 90%); however, it was not externally validated. The other study produced a filter with a lower sensitivity (72.7%) but high specificity (99.1%) with a similar performance in the external validation.
Studies reporting the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE showed similar sensitivity and precision, with one filter showing higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited information about how the filter was produced, which leaves us uncertain about their performance assessments. Newer filters had limitations in their methods or scope, including very focused subject topics for their gold standards, limiting their applicability across other topics. Our findings highlight that consensus guidance on the conduct of search filters and standardized reporting of search filters are needed, as we found highly heterogeneous development methods, accuracy assessments and outcome selection. New strategies adaptable across interfaces could enhance their usability. Moreover, the performance of existing filters needs to be evaluated in light of the impact of reporting guidelines, including the PRISMA 2009, on how systematic reviews are reported. Finally, future filter developments should also consider comparing the filters against a common reference set to establish comparative performance and assess the quality of systematic reviews retrieved by strategies.</description><subject>Checklist</subject><subject>Databases, Bibliographic</subject><subject>Humans</subject><subject>MEDLINE</subject><subject>Methodology</subject><subject>Systematic Reviews as Topic</subject><issn>1469-493X</issn><issn>1469-493X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpVUMtOwzAQtBCIlsIvVD6WQ4ofiR2fECoBKrWAeEjcIjfZtEZ5FNst6t9jiYJgL7vaGc3sDkJDSsaUEHZBY5HQNEnH8ycSKonH682CHaB-AFQUK_52-GfuoRPn3gnhitL0GPW4FClNiOyjx2fQtlhh5632sDTg8KgytQfrzrHvsCmh9abaYbdzHhrtTYEtbA18OmxaPM-uZ9P7DOu2xFmz0A5O0VGlawdn-z5ArzfZy-Qumj3cTidXs6jgkrNIskpqpRMmForHklZSpVpQAlUpOAmrIrAUDVy1SJOYskJRIngpEhBUyJIP0OW3bvi7gbIIZ1pd52trGm13eadN_h9pzSpfdtuckjjkplRQGO0VbPexAefzxrgC6lq30G1czlLBOaGMkkAd_jX7dfnJkX8BmV11pA</recordid><startdate>20230908</startdate><enddate>20230908</enddate><creator>Escobar Liquitay, Camila Micaela</creator><creator>Garegnani, Luis</creator><creator>Garrote, Virginia</creator><creator>Solà, Ivan</creator><creator>Franco, Juan Va</creator><general>John Wiley & Sons, Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20230908</creationdate><title>Search strategies (filters) to identify systematic reviews in MEDLINE and Embase</title><author>Escobar Liquitay, Camila Micaela ; Garegnani, Luis ; Garrote, Virginia ; Solà, Ivan ; Franco, Juan Va</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3732-72f7a9a526b93471f798a610efd630934c732913739b85412c91063d65e6167d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Checklist</topic><topic>Databases, Bibliographic</topic><topic>Humans</topic><topic>MEDLINE</topic><topic>Methodology</topic><topic>Systematic Reviews as Topic</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Escobar Liquitay, Camila Micaela</creatorcontrib><creatorcontrib>Garegnani, Luis</creatorcontrib><creatorcontrib>Garrote, Virginia</creatorcontrib><creatorcontrib>Solà, Ivan</creatorcontrib><creatorcontrib>Franco, Juan Va</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Cochrane database of systematic reviews</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Escobar Liquitay, Camila Micaela</au><au>Garegnani, Luis</au><au>Garrote, Virginia</au><au>Solà, Ivan</au><au>Franco, Juan Va</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Search strategies (filters) to identify systematic reviews in MEDLINE and Embase</atitle><jtitle>Cochrane database of systematic reviews</jtitle><addtitle>Cochrane Database Syst Rev</addtitle><date>2023-09-08</date><risdate>2023</risdate><volume>9</volume><issue>9</issue><spage>MR000054</spage><pages>MR000054-</pages><issn>1469-493X</issn><eissn>1469-493X</eissn><abstract>Bibliographic databases provide access to an international body of scientific literature in health and medical sciences. Systematic reviews are an important source of evidence for clinicians, researchers, consumers, and policymakers as they address a specific health-related question and use explicit methods to identify, appraise and synthesize evidence from which conclusions can be drawn and decisions made. Methodological search filters help database end-users search the literature effectively with different levels of sensitivity and specificity. These filters have been developed for various study designs and have been found to be particularly useful for intervention studies. Other filters have been developed for finding systematic reviews. Considering the variety and number of available search filters for systematic reviews, there is a need for a review of them in order to provide evidence about their retrieval properties at the time they were developed.
To review systematically empirical studies that report the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE and Embase.
We searched the following databases from inception to January 2023: MEDLINE, Embase, PsycINFO; Library, Information Science & Technology Abstracts (LISTA) and Science Citation Index (Web of Science).
We included studies if one of their primary objectives is the development, evaluation, or comparison of a search filter that could be used to retrieve systematic reviews on MEDLINE, Embase, or both.
Two review authors independently extracted data using a pre-specified and piloted data extraction form using InterTASC Information Specialist Subgroup (ISSG) Search Filter Evaluation Checklist.
We identified eight studies that developed filters for MEDLINE and three studies that developed filters for Embase. Most studies are very old and some were limited to systematic reviews in specific clinical areas. Six included studies reported the sensitivity of their developed filter. Seven studies reported precision and six studies reported specificity. Only one study reported the number needed to read and positive predictive value. None of the filters were designed to differentiate systematic reviews on the basis of their methodological quality. For MEDLINE, all filters showed similar sensitivity and precision, and one filter showed higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited study reports that may affect accuracy assessments. The report of these studies had some limitations, and the assessments of their accuracy may suffer from indirectness, considering that they were mostly developed before the release of the PRISMA 2009 statement or due to their limited scope in the selection of systematic review topics. Search filters for MEDLINE Three studies produced filters with sensitivity > 90% with variable degrees of precision, and only one of them was developed and validated in a gold-standard database, which allowed the calculation of specificity. The other two search filters had lower levels of sensitivity. One of these produced a filter with higher levels of specificity (> 90%). All filters showed similar sensitivity and precision in the external validation, except for one which was not externally validated and another one which was conceptually derived and only externally validated. Search filters for Embase We identified three studies that developed filters for this database. One of these studies developed filters with variable sensitivity and precision, including highly sensitive strategies (> 90%); however, it was not externally validated. The other study produced a filter with a lower sensitivity (72.7%) but high specificity (99.1%) with a similar performance in the external validation.
Studies reporting the development, evaluation, or comparison of search filters to retrieve reports of systematic reviews in MEDLINE showed similar sensitivity and precision, with one filter showing higher levels of specificity. For Embase, filters showed variable sensitivity and precision, with limited information about how the filter was produced, which leaves us uncertain about their performance assessments. Newer filters had limitations in their methods or scope, including very focused subject topics for their gold standards, limiting their applicability across other topics. Our findings highlight that consensus guidance on the conduct of search filters and standardized reporting of search filters are needed, as we found highly heterogeneous development methods, accuracy assessments and outcome selection. New strategies adaptable across interfaces could enhance their usability. Moreover, the performance of existing filters needs to be evaluated in light of the impact of reporting guidelines, including the PRISMA 2009, on how systematic reviews are reported. Finally, future filter developments should also consider comparing the filters against a common reference set to establish comparative performance and assess the quality of systematic reviews retrieved by strategies.</abstract><cop>England</cop><pub>John Wiley & Sons, Ltd</pub><pmid>37681507</pmid><doi>10.1002/14651858.MR000054.pub2</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1469-493X |
ispartof | Cochrane database of systematic reviews, 2023-09, Vol.9 (9), p.MR000054 |
issn | 1469-493X 1469-493X |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10485899 |
source | Alma/SFX Local Collection |
subjects | Checklist Databases, Bibliographic Humans MEDLINE Methodology Systematic Reviews as Topic |
title | Search strategies (filters) to identify systematic reviews in MEDLINE and Embase |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-21T09%3A07%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Search%20strategies%20(filters)%20to%20identify%20systematic%20reviews%20in%20MEDLINE%20and%20Embase&rft.jtitle=Cochrane%20database%20of%20systematic%20reviews&rft.au=Escobar%20Liquitay,%20Camila%20Micaela&rft.date=2023-09-08&rft.volume=9&rft.issue=9&rft.spage=MR000054&rft.pages=MR000054-&rft.issn=1469-493X&rft.eissn=1469-493X&rft_id=info:doi/10.1002/14651858.MR000054.pub2&rft_dat=%3Cproquest_pubme%3E2863301210%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c3732-72f7a9a526b93471f798a610efd630934c732913739b85412c91063d65e6167d3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2863301210&rft_id=info:pmid/37681507&rfr_iscdi=true |