Improving Search Efficiency for Systematic Reviews of Diagnostic Test Accuracy: an Exploratory Study to Assess the Viability of Limiting to MEDLINE, EMBASE and Reference Checking

Overview

Journal Syst Rev

Publisher Biomed Central

Date 2015 Jun 27

PMID 26113080

Citations 11

Authors

Louise Preston

Christopher Carroll

Paolo Gardois

Suzy Paisley

Eva Kaltenthaler

Affiliations

Soon will be listed here.

Abstract

Background: Increasing numbers of systematic reviews evaluating the diagnostic test accuracy of technologies are being published. Currently, review teams tend to apply conventional systematic review standards to identify relevant studies for inclusion, for example sensitive searches of multiple bibliographic databases. There has been little evaluation of the efficiency of searching only one or two such databases for this type of review. The aim of this study was to assess the viability of an approach that restricted searches to MEDLINE, EMBASE and the reference lists of included studies.

Methods: A convenience sample of nine Health Technology Assessment (HTA) systematic reviews of diagnostic test accuracy, with 302 included citations, was analysed to determine the number and proportion of included citations that were indexed in and retrieved from MEDLINE and EMBASE. An assessment was also made of the number and proportion of citations not retrieved from these databases but that could have been identified from the reference lists of included citations.

Results: 287/302 (95 %) of the included citations in the nine reviews were indexed across MEDLINE and EMBASE. The reviews' searches of MEDLINE and EMBASE accounted for 85 % of the included citations (256/302). Of the forty-six (15 %) included citations not retrieved by the published searches, 24 (8 %) could be found in the reference lists of included citations. Only 22/302 (7 %) of the included citations were not found by the proposed, more efficient approach.

Conclusions: The proposed approach would have accounted for 280/302 (93 %) of included citations in this sample of nine systematic reviews. This exploratory study suggests that there might be a case for restricting searches for systematic reviews of diagnostic test accuracy studies to MEDLINE, EMBASE and the reference lists of included citations. The conduct of such reviews might be rendered more efficient by using this approach.

Citing Articles

An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review.

Affengruber L, van der Maten M, Spiero I, Nussbaumer-Streit B, Mahmic-Kaknjo M, Ellen M BMC Med Res Methodol. 2024; 24(1):210.

PMID: 39294580 PMC: 11409535. DOI: 10.1186/s12874-024-02320-4.

Empirical Testing of Alternative Search Methods to Retrieve Utility Values for Health Economic Modelling.

Lister J, Paisley S, Carroll C, Tappenden P Pharmacoeconomics. 2024; 42(11):1255-1266.

PMID: 39107622 DOI: 10.1007/s40273-024-01414-7.

Differences in Dental Implant Survival between Immediate vs. Delayed Placement: A Systematic Review and Meta-Analysis.

Patel R, Ucer C, Wright S, Khan R Dent J (Basel). 2023; 11(9).

PMID: 37754338 PMC: 10528222. DOI: 10.3390/dj11090218.

Diagnostic accuracy of OCTA and OCT for myopic choroidal neovascularisation: a systematic review and meta-analysis.

Ho S, Ly A, Ohno-Matsui K, Kalloniatis M, Doig G Eye (Lond). 2022; 37(1):21-29.

PMID: 36456704 PMC: 9829918. DOI: 10.1038/s41433-022-02227-8.

Choosing which in-hospital laboratory tests to target for intervention: a scoping review.

Podolsky E, Hudek N, McCudden C, Presseau J, Yanikomeroglu S, Brouwers M Clin Chem Lab Med. 2022; 61(3):388-401.

PMID: 36410390 PMC: 9876731. DOI: 10.1515/cclm-2022-0910.

References

Whiting P, Rutjes A, Westwood M, Mallett S, Deeks J, Reitsma J . QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011; 155(8):529-36. DOI: 10.7326/0003-4819-155-8-201110180-00009. View

Stevenson M, Lloyd-Jones M, Morgan M, Wong R . Non-invasive diagnostic assessment tools for the detection of liver fibrosis in patients with suspected alcohol-related liver disease: a systematic review and economic evaluation. Health Technol Assess. 2012; 16(4):1-174. PMC: 4781535. DOI: 10.3310/hta16040. View

Goodacre S, Thokala P, Carroll C, Stevens J, Leaviss J, Al Khalaf M . Systematic review, meta-analysis and economic modelling of diagnostic strategies for suspected acute coronary syndrome. Health Technol Assess. 2013; 17(1):v-vi, 1-188. PMC: 4780933. DOI: 10.3310/hta17010. View

Beyer F, Wright K . Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. Health Info Libr J. 2013; 30(1):49-58. DOI: 10.1111/hir.12009. View

Simpson E, Stevenson M, Scope A, Poku E, Minton J, Evans P . Echocardiography in newly diagnosed atrial fibrillation patients: a systematic review and economic evaluation. Health Technol Assess. 2013; 17(36):1-263, v-vi. PMC: 4781049. DOI: 10.3310/hta17360. View

Ward S, Scope A, Rafia R, Pandor A, Harnan S, Evans P . Gene expression profiling and expanded immunohistochemistry tests to guide the use of adjuvant chemotherapy in breast cancer management: a systematic review and cost-effectiveness analysis. Health Technol Assess. 2013; 17(44):1-302. PMC: 4780957. DOI: 10.3310/hta17440. View

Leeflang M, Deeks J, Takwoingi Y, Macaskill P . Cochrane diagnostic test accuracy reviews. Syst Rev. 2013; 2:82. PMC: 3851548. DOI: 10.1186/2046-4053-2-82. View

Holmes M, Rathbone J, Littlewood C, Rawdin A, Stevenson M, Stevens J . Routine echocardiography in the management of stroke and transient ischaemic attack: a systematic review and economic evaluation. Health Technol Assess. 2014; 18(16):1-176. PMC: 4781342. DOI: 10.3310/hta18160. View

van Enst W, Scholten R, Whiting P, Zwinderman A, Hooft L . Meta-epidemiologic analysis indicates that MEDLINE searches are sufficient for diagnostic test accuracy systematic reviews. J Clin Epidemiol. 2014; 67(11):1192-9. DOI: 10.1016/j.jclinepi.2014.05.008. View

10.

Schunemann H, Moja L . Reviews: Rapid! Rapid! Rapid! …and systematic. Syst Rev. 2015; 4:4. PMC: 4320433. DOI: 10.1186/2046-4053-4-4. View

11.

Song F, Khan K, Dinnes J, Sutton A . Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002; 31(1):88-95. DOI: 10.1093/ije/31.1.88. View

12.

Egger M, Juni P, Bartlett C, Holenstein F, Sterne J . How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003; 7(1):1-76. View

13.

Royle P, Waugh N . Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system. Health Technol Assess. 2003; 7(34):iii, ix-x, 1-51. DOI: 10.3310/hta7340. View

14.

Kaltenthaler E, Bravo Vergel Y, Chilcott J, Thomas S, Blakeborough T, Walters S . A systematic review and economic evaluation of magnetic resonance cholangiopancreatography compared with diagnostic endoscopic retrograde cholangiopancreatography. Health Technol Assess. 2004; 8(10):iii, 1-89. DOI: 10.3310/hta8100. View

15.

Pandor A, Eastham J, Beverley C, Chilcott J, Paisley S . Clinical effectiveness and cost-effectiveness of neonatal screening for inborn errors of metabolism using tandem mass spectrometry: a systematic review. Health Technol Assess. 2004; 8(12):iii, 1-121. DOI: 10.3310/hta8120. View

16.

Scherer R, Dickersin K, Langenberg P . Full publication of results initially presented in abstracts. A meta-analysis. JAMA. 1994; 272(2):158-62. View

17.

Whiting P, Westwood M, Burke M, Sterne J, Glanville J . Systematic reviews of test accuracy should search a range of databases to identify primary studies. J Clin Epidemiol. 2008; 61(4):357-364. DOI: 10.1016/j.jclinepi.2007.05.013. View

18.

Leeflang M, Deeks J, Gatsonis C, Bossuyt P . Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008; 149(12):889-97. PMC: 2956514. DOI: 10.7326/0003-4819-149-12-200812160-00008. View

19.

Sutcliffe P, Hummel S, Simpson E, Young T, Rees A, Wilkinson A . Use of classical and novel biomarkers as prognostic risk factors for localised prostate cancer: a systematic review. Health Technol Assess. 2009; 13(5):iii, xi-xiii 1-219. DOI: 10.3310/hta13050. View

20.

Booth A . How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. Int J Technol Assess Health Care. 2010; 26(4):431-5. DOI: 10.1017/S0266462310000966. View