Developing Optimal Search Strategies for Detecting Clinically Relevant Qualitative Studies in MEDLINE

Background: The growing interest in qualitative research within the evidence based practice framework highlights the need for accurate search strategies to enhance the retrieval of qualitative studies. To date, little work has been done on developing optimal search filters for retrieving qualitative studies. The current study extends our earlier work, on developing optimal search strategies, to include qualitative studies.

Objective: To develop optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE in the publishing year 2000.

Design: Comparison of the retrieval performance of methodologic search strategies in MEDLINE with a manual review ("gold standard") of each article for each issue of 161 core health care journals for the year 2000.

Methods: 6 experienced research assistants who had been trained and intensively calibrated reviewed all issues of 161 journals for the publishing year 2000. Each article was systematically classified for "format" (whether it was an original study, review article, general article, or case report), "interest" (whether or not it was of interest to the health care of humans), and "purpose" (whether it pertained to therapy, diagnosis, prognosis, causation, economics, costs, or clinical prediction; was of a qualitative nature; or was about something else). Search strategies were developed for all purpose categories, including qualitative studies.

Main Outcome Measures: The sensitivity (recall), specificity, precision, and accuracy of single and combinations of search terms.

Results: 49,028 articles were identified after matching the hand search records with the data downloaded from MEDLINE, of which 366 (0.75%) were classified as qualitative. Combinations of search terms reached peak sensitivities of 95%. Compared with the best single term, a three-term strategy increased sensitivity for qualitative studies by 23.6% (absolute increase), but with some loss of specificity when sensitivity was maximized. When search terms were combined to optimize sensitivity and specificity, both these values peaked above 90%.

Conclusion: Several search strategies can achieve high performance in retrieving qualitative studies from MEDLINE.