Systematic Reviews of Health Effects of Social Interventions: 1. Finding the Evidence: How Far Should You Go?

Overview

Journal J Epidemiol Community Health

Specialty Health Services

Date 2005 Aug 16

PMID 16100321

Citations 39

Authors

David Ogilvie

Val Hamilton

Matt Egan

Mark Petticrew

Affiliations

Soon will be listed here.

Abstract

Study Objective: There is little guidance on how to identify useful evidence about the health effects of social interventions. The aim of this study was to assess the value of different ways of finding this type of information.

Design: Retrospective analysis of the sources of studies for one systematic review.

Setting: Case study of a systematic review of the effectiveness of interventions in promoting a population shift from using cars towards walking and cycling.

Main Results: Only four of the 69 relevant studies were found in a "first-line" health database such as Medline. About half of all relevant studies were found through the specialist Transport database. Nine relevant studies were found through purposive internet searches and seven relevant studies were found by chance. The unique contribution of experts was not to identify additional studies, but to provide more information about those already found in the literature.

Conclusions: Most of the evidence needed for this review was not found in studies indexed in familiar literature databases. Applying a sensitive search strategy across multiple databases and interfaces is very labour intensive. Retrospective analysis suggests that a more efficient method might have been to search a few key resources, then to ask authors and experts directly for the most robust reports of studies identified. However, internet publications and serendipitous discoveries did make a significant contribution to the total set of relevant evidence. Undertaking a comprehensive search may provide unique evidence and insights that would not be obtained using a more focused search.

Citing Articles

Searching for studies: A guide to information retrieval for Campbell systematic reviews.

MacDonald H, Comer C, Foster M, Labelle P, Marsalis S, Nyhan K Campbell Syst Rev. 2024; 20(3):e1433.

PMID: 39258215 PMC: 11386270. DOI: 10.1002/cl2.1433.

Do Interventions Reducing Social Vulnerability Improve Health in Community Dwelling Older Adults? A Systematic Review.

Mah J, Rockwood K, Stevens S, Keefe J, Andrew M Clin Interv Aging. 2022; 17:447-465.

PMID: 35431543 PMC: 9012306. DOI: 10.2147/CIA.S349836.

Are workplace health promotion programmes effective for all socioeconomic groups? A systematic review.

van de Ven D, Robroek S, Burdorf A Occup Environ Med. 2020; 77(9):589-596.

PMID: 32217755 PMC: 7547856. DOI: 10.1136/oemed-2019-106311.

Evaluating the effectiveness, efficiency, cost and value of contacting study authors in a systematic review: a case study and worked example.

Cooper C, Bou J, Varley-Campbell J BMC Med Res Methodol. 2019; 19(1):45.

PMID: 30836935 PMC: 6399953. DOI: 10.1186/s12874-019-0685-0.

Defining the process to literature searching in systematic reviews: a literature review of guidance and supporting studies.

Cooper C, Booth A, Varley-Campbell J, Britten N, Garside R BMC Med Res Methodol. 2018; 18(1):85.

PMID: 30107788 PMC: 6092796. DOI: 10.1186/s12874-018-0545-3.

References

Ogilvie D, Egan M, Hamilton V, Petticrew M . Promoting walking and cycling as an alternative to using cars: systematic review. BMJ. 2004; 329(7469):763. PMC: 520994. DOI: 10.1136/bmj.38216.714560.55. View

Jackson N, Waters E . The challenges of systematically reviewing public health interventions. J Public Health (Oxf). 2004; 26(3):303-7. DOI: 10.1093/pubmed/fdh164. View

Green J, Tones K . Towards a secure evidence base for health promotion. J Public Health Med. 1999; 21(2):133-9. DOI: 10.1093/pubmed/21.2.133. View

Matthews E, Edwards A, Barker J, Bloor M, Covey J, Hood K . Efficient literature searching in diffuse topics: lessons from a systematic review of research on communicating risk to patients in primary care. Health Libr Rev. 1999; 16(2):112-20. DOI: 10.1046/j.1365-2532.1999.00219.x. View

Stevinson C, Lawlor D . Searching multiple databases for systematic reviews: added value or diminishing returns?. Complement Ther Med. 2005; 12(4):228-32. DOI: 10.1016/j.ctim.2004.09.003. View

Smith R, Chalmers I . Britain's gift: a "Medline" of synthesised evidence. BMJ. 2001; 323(7327):1437-8. PMC: 1121895. DOI: 10.1136/bmj.323.7327.1437. View

McAuley L, Pham B, Tugwell P, Moher D . Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. Lancet. 2000; 356(9237):1228-31. DOI: 10.1016/S0140-6736(00)02786-0. View

Macintyre S, Chalmers I, Horton R, Smith R . Using evidence to inform health policy: case study. BMJ. 2001; 322(7280):222-5. PMC: 1119477. DOI: 10.1136/bmj.322.7280.222. View

Clarke M, Langhorne P . Revisiting the Cochrane Collaboration. Meeting the challenge of Archie Cochrane--and facing up to some new ones. BMJ. 2001; 323(7317):821. PMC: 1121374. DOI: 10.1136/bmj.323.7317.821. View

10.

Macintyre S, Petticrew M . Good intentions and received wisdom are not enough. J Epidemiol Community Health. 2000; 54(11):802-3. PMC: 1731585. DOI: 10.1136/jech.54.11.802. View

11.

Rychetnik L, Frommer M, HAWE P, Shiell A . Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002; 56(2):119-27. PMC: 1732065. DOI: 10.1136/jech.56.2.119. View

12.

Helmer D, Savoie I, Green C, Kazanjian A . Evidence-based practice: extending the search to find material for the systematic review. Bull Med Libr Assoc. 2002; 89(4):346-52. PMC: 57963. View

13.

Dickersin K . Systematic reviews in epidemiology: why are we so far behind?. Int J Epidemiol. 2002; 31(1):6-12. DOI: 10.1093/ije/31.1.6. View

14.

Hawker S, Payne S, Kerr C, Hardey M, Powell J . Appraising the evidence: reviewing disparate data systematically. Qual Health Res. 2002; 12(9):1284-99. DOI: 10.1177/1049732302238251. View

15.

Petticrew M . Presumed innocent. Why we need systematic reviews of social policies. Am J Prev Med. 2003; 24(3 Suppl):2-3. DOI: 10.1016/s0749-3797(02)00650-5. View

16.

Joffe M, Mindell J . Congestion charging. Walking classes also need road space reallocation. BMJ. 2003; 326(7394):884. PMC: 1125786. DOI: 10.1136/bmj.326.7394.884. View

17.

Petticrew M, Roberts H . Evidence, hierarchies, and typologies: horses for courses. J Epidemiol Community Health. 2003; 57(7):527-9. PMC: 1732497. DOI: 10.1136/jech.57.7.527. View

18.

Egan M, Petticrew M, Ogilvie D, Hamilton V . New roads and human health: a systematic review. Am J Public Health. 2003; 93(9):1463-71. PMC: 1447994. DOI: 10.2105/ajph.93.9.1463. View

19.

Thomson H, Hoskins R, Petticrew M, Ogilvie D, Craig N, Quinn T . Evaluating the health effects of social interventions. BMJ. 2004; 328(7434):282-5. PMC: 324463. DOI: 10.1136/bmj.328.7434.282. View

20.

Howes F, Doyle J, Jackson N, Waters E . Evidence-based public health: The importance of finding 'difficult to locate' public health and health promotion intervention studies for systematic reviews. J Public Health (Oxf). 2004; 26(1):101-4. DOI: 10.1093/pubmed/fdh119. View