MEDLINE Clinical Queries Are Robust when Searching in Recent Publishing Years

Overview

Journal J Am Med Inform Assoc

Publisher Oxford University Press

Specialty Medical Informatics

Date 2012 Sep 29

PMID 23019242

Citations 30

Authors

Nancy L Wilczynski

K Ann McKibbon

Stephen D Walter

Amit X Garg

R Brian Haynes

Affiliations

Soon will be listed here.

Abstract

Objective: To determine if the PubMed and Ovid MEDLINE clinical queries (which were developed in the publishing year 2000, for the purpose categories therapy, diagnosis, prognosis, etiology, and clinical prediction guides) perform as well when searching in current publishing years.

Methods: A gold standard database of recently published research literature was created using the McMaster health knowledge refinery (http://hiru.mcmaster.ca/hiru/HIRU_McMaster_HKR.aspx) and its continuously updated database, McMaster PLUS (http://hiru.mcmaster.ca/hiru/HIRU_McMaster_PLUS_projects.aspx). This database contains articles from over 120 clinical journals that are tagged for meeting or not meeting criteria for scientific merit and clinical relevance. The clinical queries sensitive ('broad') and specific ('narrow') search filters were tested in this gold standard database, and sensitivity and specificity were calculated and compared with those originally reported for the clinical queries.

Results: In all cases, the sensitivity of the highly sensitive search filters and the specificity of the highly specific search filters did not differ substantively when comparing results derived in 2000 with those derived in a more current database. In addition, in all cases, the specificities for the highly sensitive search filters and the sensitivities for the highly specific search filters remained above 50% when testing them in the current database.

Discussion: These results are reassuring for modern-day searchers. The clinical queries that were derived in the year 2000 perform equally well a decade later.

Conclusion: The PubMed and Ovid MEDLINE clinical queries have been revalidated and remain a useful public resource for searching the world's medical literature for research that is most relevant to clinical care.

Citing Articles

Boosting efficiency in a clinical literature surveillance system with LightGBM.

Lokker C, Abdelkader W, Bagheri E, Parrish R, Cotoi C, Navarro T PLOS Digit Health. 2024; 3(9):e0000299.

PMID: 39312500 PMC: 11419392. DOI: 10.1371/journal.pdig.0000299.

The McMaster Health Information Research Unit: Over a Quarter-Century of Health Informatics Supporting Evidence-Based Medicine.

Lokker C, McKibbon K, Afzal M, Navarro T, Linkins L, Haynes R J Med Internet Res. 2024; 26:e58764.

PMID: 39083765 PMC: 11325105. DOI: 10.2196/58764.

Poor reporting quality of randomized controlled trials comparing treatments of COVID-19-A retrospective cross-sectional study on the first year of publications.

Grusser L, Eissing C, Kowark A, Keszei A, Wallqvist J, Rossaint R PLoS One. 2023; 18(10):e0292860.

PMID: 37844082 PMC: 10578566. DOI: 10.1371/journal.pone.0292860.

Preliminary comparison of the performance of the National Library of Medicine's systematic review publication type and the sensitive clinical queries filter for systematic reviews in PubMed.

Navarro-Ruan T, Haynes R J Med Libr Assoc. 2022; 110(1):43-46.

PMID: 35210961 PMC: 8830395. DOI: 10.5195/jmla.2022.1286.

Aducanumab Use in Symptomatic Alzheimer Disease Evidence in Focus: A Report of the AAN Guidelines Subcommittee.

Day G, Scarmeas N, Dubinsky R, Coerver K, Mostacero A, West B Neurology. 2022; 98(15):619-631.

PMID: 35197360 PMC: 9012273. DOI: 10.1212/WNL.0000000000200176.

References

Wilczynski N, Haynes R . Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey. BMC Med. 2004; 2:23. PMC: 441418. DOI: 10.1186/1741-7015-2-23. View

Westbrook J, Gosling A, Coiera E . Do clinicians use online evidence to support patient care? A study of 55,000 clinicians. J Am Med Inform Assoc. 2003; 11(2):113-20. PMC: 353016. DOI: 10.1197/jamia.M1385. View

Schulz K, Altman D, Moher D . CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010; 340:c332. PMC: 2844940. DOI: 10.1136/bmj.c332. View

Haynes R, Wilczynski N . Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey. BMJ. 2004; 328(7447):1040. PMC: 403841. DOI: 10.1136/bmj.38068.557998.EE. View

Schwartz K, Roe T, Northrup J, Meza J, Seifeldin R, Neale A . Family medicine patients' use of the Internet for health information: a MetroNet study. J Am Board Fam Med. 2006; 19(1):39-45. DOI: 10.3122/jabfm.19.1.39. View

Shariff S, Sontrop J, Haynes R, Iansavichus A, McKibbon K, Wilczynski N . Impact of PubMed search filters on the retrieval of evidence by physicians. CMAJ. 2012; 184(3):E184-90. PMC: 3281182. DOI: 10.1503/cmaj.101661. View

Demner-Fushman D, Hauser S, Humphrey S, Ford G, Jacobs J, Thoma G . MEDLINE as a source of just-in-time answers to clinical questions. AMIA Annu Symp Proc. 2007; :190-4. PMC: 1839449. View

Bossuyt P, Reitsma J, Bruns D, Gatsonis C, Glasziou P, Irwig L . Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003; 326(7379):41-4. PMC: 1124931. DOI: 10.1136/bmj.326.7379.41. View

Moher D, Liberati A, Tetzlaff J, Altman D . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009; 339:b2535. PMC: 2714657. DOI: 10.1136/bmj.b2535. View

10.

Wilczynski N, Haynes R . Developing optimal search strategies for detecting clinically sound causation studies in MEDLINE. AMIA Annu Symp Proc. 2004; :719-23. PMC: 1480286. View

11.

Wong S, Wilczynski N, Haynes R, Ramkissoonsingh R . Developing optimal search strategies for detecting sound clinical prediction studies in MEDLINE. AMIA Annu Symp Proc. 2004; :728-32. PMC: 1479983. View

12.

Haynes R, McKibbon K, Wilczynski N, Walter S, Werre S . Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey. BMJ. 2005; 330(7501):1179. PMC: 558012. DOI: 10.1136/bmj.38446.498542.8F. View

13.

Yao X, Wilczynski N, Walter S, Haynes R . Sample size determination for bibliographic retrieval studies. BMC Med Inform Decis Mak. 2008; 8:43. PMC: 2569926. DOI: 10.1186/1472-6947-8-43. View

14.

Cullen R . In search of evidence: family practitioners' use of the Internet for clinical information. J Med Libr Assoc. 2002; 90(4):370-9. PMC: 128953. View

15.

Kilicoglu H, Demner-Fushman D, Rindflesch T, Wilczynski N, Haynes R . Towards automatic recognition of scientifically rigorous clinical research evidence. J Am Med Inform Assoc. 2008; 16(1):25-31. PMC: 2605595. DOI: 10.1197/jamia.M2996. View

16.

Peterson G, Aslani P, Williams K . How do consumers search for and appraise information on medicines on the Internet? A qualitative study using focus groups. J Med Internet Res. 2004; 5(4):e33. PMC: 1550579. DOI: 10.2196/jmir.5.4.e33. View