Ten Simple Rules for Conducting Umbrella Reviews

Overview

Journal Evid Based Ment Health

Specialty Psychology

Date 2018 Jul 15

PMID 30006442

Citations 197

Authors

Paolo Fusar-Poli

Joaquim Radua

Affiliations

Soon will be listed here.

Abstract

Objective: Evidence syntheses such as systematic reviews and meta-analyses provide a rigorous and transparent knowledge base for translating clinical research into decisions, and thus they represent the basic unit of knowledge in medicine. Umbrella reviews are reviews of previously published systematic reviews or meta-analyses. Therefore, they represent one of the highest levels of evidence synthesis currently available, and are becoming increasingly influential in biomedical literature. However, practical guidance on how to conduct umbrella reviews is relatively limited.

Methods: We present a critical educational review of published umbrella reviews, focusing on the essential practical steps required to produce robust umbrella reviews in the medical field.

Results: The current manuscript discusses 10 key points to consider for conducting robust umbrella reviews. The points are: ensure that the umbrella review is really needed, prespecify the protocol, clearly define the variables of interest, estimate a common effect size, report the heterogeneity and potential biases, perform a stratification of the evidence, conduct sensitivity analyses, report transparent results, use appropriate software and acknowledge the limitations. We illustrate these points through recent examples from umbrella reviews and suggest specific practical recommendations.

Conclusions: The current manuscript provides a practical guidance for conducting umbrella reviews in medical areas. Researchers, clinicians and policy makers might use the key points illustrated here to inform the planning, conduction and reporting of umbrella reviews in medicine.

Citing Articles

Association between SARS-CoV-2 and stroke: perspectives from a metaumbrella-review.

de Souza A, de Araujo E, Junior N, Raimundo A, Pereira A, de Castro Meneghim M BMC Neurol. 2025; 25(1):97.

PMID: 40055630 PMC: 11887298. DOI: 10.1186/s12883-025-04041-7.

Community-based interventions on the social determinants of mental health in the UK: an umbrella review.

J Public Ment Health. 2025; .

PMID: 40051417 PMC: 7617460. DOI: 10.1108/JPMH-07-2024-0087.

Factors involving in healthcare professionals' decision-making process regarding the use of restrictive care practices in adult mental health inpatient units: A protocol for an umbrella review.

Belayneh Z, Yenealem B, Molla A, Alemnew N, Ergetie T, Mekonnen W PLoS One. 2025; 20(2):e0319228.

PMID: 39992991 PMC: 11849846. DOI: 10.1371/journal.pone.0319228.

Heart disease in pregnancy and adverse outcomes: an umbrella review.

Zhang J, Ren Y, Li B, Cao Q, Wang X, Yu H Front Med (Lausanne). 2025; 12:1489991.

PMID: 39975686 PMC: 11836018. DOI: 10.3389/fmed.2025.1489991.

EnvironMental Health: A Framework for an Emerging Field at the Intersection of the Environment and Mental Health Crises.

Ratjen L, Goddard E, Gilcher E, Nguyen B, Kelley M, Feldman H Geohealth. 2025; 9(2):e2024GH001254.

PMID: 39958831 PMC: 11826329. DOI: 10.1029/2024GH001254.

References

Veroniki A, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G . Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res Synth Methods. 2015; 7(1):55-79. PMC: 4950030. DOI: 10.1002/jrsm.1164. View

Ioannidis J, Munafo M, Fusar-Poli P, Nosek B, David S . Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention. Trends Cogn Sci. 2014; 18(5):235-41. PMC: 4078993. DOI: 10.1016/j.tics.2014.02.010. View

Siontis K, Hernandez-Boussard T, Ioannidis J . Overlapping meta-analyses on the same topic: survey of published studies. BMJ. 2013; 347:f4501. PMC: 3716360. DOI: 10.1136/bmj.f4501. View

Petropoulou M, Mavridis D . A comparison of 20 heterogeneity variance estimators in statistical synthesis of results from studies: a simulation study. Stat Med. 2017; 36(27):4266-4280. DOI: 10.1002/sim.7431. View

Krause D, Roupas P . Dietary interventions as a neuroprotective therapy for the delay of the onset of cognitive decline in older adults: an umbrella review protocol. JBI Database System Rev Implement Rep. 2015; 13(2):74-83. DOI: 10.11124/jbisrir-2015-1899. View

Chai L, Burrows T, May C, Brain K, Wong See D, Collins C . Effectiveness of family-based weight management interventions in childhood obesity: an umbrella review protocol. JBI Database System Rev Implement Rep. 2016; 14(9):32-39. DOI: 10.11124/JBISRIR-2016-003082. View

Bellou V, Belbasis L, Tzoulaki I, Middleton L, Ioannidis J, Evangelou E . Systematic evaluation of the associations between environmental risk factors and dementia: An umbrella review of systematic reviews and meta-analyses. Alzheimers Dement. 2016; 13(4):406-418. DOI: 10.1016/j.jalz.2016.07.152. View

Fusar-Poli P, Cappucciati M, Bonoldi I, Hui L, Rutigliano G, Stahl D . Prognosis of Brief Psychotic Episodes: A Meta-analysis. JAMA Psychiatry. 2016; 73(3):211-20. DOI: 10.1001/jamapsychiatry.2015.2313. View

Thomson K, Bambra C, McNamara C, Huijts T, Todd A . The effects of public health policies on population health and health inequalities in European welfare states: protocol for an umbrella review. Syst Rev. 2016; 5:57. PMC: 4826536. DOI: 10.1186/s13643-016-0235-3. View

10.

Fusar-Poli P, Cappucciati M, Borgwardt S, Woods S, Addington J, Nelson B . Heterogeneity of Psychosis Risk Within Individuals at Clinical High Risk: A Meta-analytical Stratification. JAMA Psychiatry. 2016; 73(2):113-20. DOI: 10.1001/jamapsychiatry.2015.2324. View

11.

Radua J, Schmidt A, Borgwardt S, Heinz A, Schlagenhauf F, McGuire P . Ventral Striatal Activation During Reward Processing in Psychosis: A Neurofunctional Meta-Analysis. JAMA Psychiatry. 2015; 72(12):1243-51. DOI: 10.1001/jamapsychiatry.2015.2196. View

12.

Radua J, Ramella-Cravaro V, Ioannidis J, Reichenberg A, Phiphopthatsanee N, Amir T . What causes psychosis? An umbrella review of risk and protective factors. World Psychiatry. 2018; 17(1):49-66. PMC: 5775150. DOI: 10.1002/wps.20490. View

13.

Elliott J, Kelly S, Bai Z, Liu W, Skidmore B, Boucher M . Optimal duration of dual antiplatelet therapy following percutaneous coronary intervention: protocol for an umbrella review. BMJ Open. 2017; 7(4):e015421. PMC: 5387937. DOI: 10.1136/bmjopen-2016-015421. View

14.

Moher D, Liberati A, Tetzlaff J, Altman D . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009; 62(10):1006-12. DOI: 10.1016/j.jclinepi.2009.06.005. View

15.

Jadczak A, Makwana N, Luscombe-Marsh N, Visvanathan R, Schultz T . Effectiveness of exercise interventions on physical function in community-dwelling frail older people: an umbrella review protocol. JBI Database System Rev Implement Rep. 2016; 14(9):93-102. DOI: 10.11124/JBISRIR-2016-003081. View

16.

Chinn S . A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat Med. 2000; 19(22):3127-31. DOI: 10.1002/1097-0258(20001130)19:22<3127::aid-sim784>3.0.co;2-m. View

17.

Schmidt A, Cappucciati M, Radua J, Rutigliano G, Rocchetti M, DellOsso L . Improving Prognostic Accuracy in Subjects at Clinical High Risk for Psychosis: Systematic Review of Predictive Models and Meta-analytical Sequential Testing Simulation. Schizophr Bull. 2016; 43(2):375-388. PMC: 5605272. DOI: 10.1093/schbul/sbw098. View

18.

Dinsdale S, Azevedo L, Shucksmith J, Newham J, Ells L, Jones D . Effectiveness of weight management, smoking cessation and alcohol reduction interventions in changing behaviors during pregnancy: an umbrella review protocol. JBI Database System Rev Implement Rep. 2016; 14(10):29-47. DOI: 10.11124/JBISRIR-2016-003162. View

19.

Catala-Lopez F, Hutton B, Driver J, Page M, Ridao M, Valderas J . Cancer and central nervous system disorders: protocol for an umbrella review of systematic reviews and updated meta-analyses of observational studies. Syst Rev. 2017; 6(1):69. PMC: 5379758. DOI: 10.1186/s13643-017-0466-y. View

20.

Ioannidis J . The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q. 2016; 94(3):485-514. PMC: 5020151. DOI: 10.1111/1468-0009.12210. View