The Status Quo of Systematic Reviews Published in High-impact Journals in Korea: a Study Focused on Protocol Registration and GRADE Use

Overview

Journal Epidemiol Health

Specialty Public Health

Date 2022 Nov 18

PMID 36397240

Authors

Mi Ah Han

Seong Jung Kim

Eu Chang Hwang

Jae Hung Jung

Affiliations

Soon will be listed here.

Abstract

Objectives: This study investigated the status quo of systematic reviews published in major journals in Korea from the perspective of protocol registration and adopting the grading of recommendation, assessment, development and evaluation (GRADE) system.

Methods: We examined systematic reviews published in Korea's top 15 medical journals from 2018 to 2021. Teams of 2 reviewers assessed the studies' eligibility criteria and extracted data independently and in duplicate. We collected information on study characteristics, protocol registration, and GRADE use of the included reviews, and reviewed the "Instructions for Authors" of the selected journals to assess any guidance related to systematic reviews.

Results: Out of the 126 identified reviews, 18 (14.3%) reported that they registered or published their protocol. Only 5 (4.0%) rated the certainty of evidence; and all 5 used the GRADE system. Only 6 of 15 journals mentioned systematic reviews in their "Instructions for Authors." Six journals endorsed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework for systematic review reporting (2 mandatory, 3 recommended, and 1 unclear). None of the journals included mentioned protocol registration or certainty of evidence in their authors' guidelines.

Conclusions: Overall, the proportion of systematic reviews that had prior protocol registration or used the GRADE approach to rate the certainty of evidence was very low. Our study highlights the need for adherence to systematic review standards in medical journals in Korea, including prior protocol registration and certainty of evidence assessment. Our review will help improve the quality of systematic reviews in Korea.

References

Park S, Choi M, Choi J, Park E, Tchoe H, Suh J . Comparative Efficacy and Safety of Long-acting Injectable and Oral Second-generation Antipsychotics for the Treatment of Schizophrenia: A Systematic Review and Meta-analysis. Clin Psychopharmacol Neurosci. 2018; 16(4):361-375. PMC: 6245299. DOI: 10.9758/cpn.2018.16.4.361. View

Page M, McKenzie J, Bossuyt P, Boutron I, Hoffmann T, Mulrow C . The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021; 372:n71. PMC: 8005924. DOI: 10.1136/bmj.n71. View

Werner S, Binder N, Toews I, Schunemann H, Meerpohl J, Schwingshackl L . Use of GRADE in evidence syntheses published in high-impact-factor nutrition journals: A methodological survey. J Clin Epidemiol. 2021; 135:54-69. DOI: 10.1016/j.jclinepi.2021.02.010. View

Ashe M, Dos Santos I, Edward N, Burnett L, Barnes R, Fleig L . Physical Activity and Bone Health in Men: A Systematic Review and Meta-Analysis. J Bone Metab. 2021; 28(1):27-39. PMC: 7973404. DOI: 10.11005/jbm.2021.28.1.27. View

Osto M, Edriss M, Hamzavi I . Prospective protocol registration should be required for systematic reviews in dermatology literature. Clin Dermatol. 2021; 40(2):225-227. DOI: 10.1016/j.clindermatol.2021.11.016. View

Tao K, Li X, Zhou Q, Moher D, Ling C, Yu W . From QUOROM to PRISMA: a survey of high-impact medical journals' instructions to authors and a review of systematic reviews in anesthesia literature. PLoS One. 2011; 6(11):e27611. PMC: 3217994. DOI: 10.1371/journal.pone.0027611. View

Smith T, Kulatilake P, Brown L, Wigley J, Hameed W, Shantikumar S . Do surgery journals insist on reporting by CONSORT and PRISMA? A follow-up survey of 'instructions to authors'. Ann Med Surg (Lond). 2015; 4(1):17-21. PMC: 4323756. DOI: 10.1016/j.amsu.2014.12.003. View

Tawfik G, Giang H, Ghozy S, Altibi A, Kandil H, Le H . Protocol registration issues of systematic review and meta-analysis studies: a survey of global researchers. BMC Med Res Methodol. 2020; 20(1):213. PMC: 7448304. DOI: 10.1186/s12874-020-01094-9. View

Kim P, Suh C, Kim H, Kim K, Kim D, Lee E . Immune Checkpoint Inhibitor with or without Radiotherapy in Melanoma Patients with Brain Metastases: A Systematic Review and Meta-Analysis. Korean J Radiol. 2020; 22(4):584-595. PMC: 8005357. DOI: 10.3348/kjr.2020.0728. View

10.

Guyatt G, Oxman A, Akl E, Kunz R, Vist G, Brozek J . GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011; 64(4):383-94. DOI: 10.1016/j.jclinepi.2010.04.026. View

11.

Santos M, Agostini B, Bassani R, Pereira G, Sarkis-Onofre R . Protocol registration improves reporting quality of systematic reviews in dentistry. BMC Med Res Methodol. 2020; 20(1):57. PMC: 7065343. DOI: 10.1186/s12874-020-00939-7. View

12.

Kim S, Han M, Jung J, Hwang E, Kim H, Yoon S . Prevalence and methodological quality of systematic reviews in Korean medical journals. Epidemiol Health. 2023; 45:e2023017. PMC: 10266932. DOI: 10.4178/epih.e2023017. View

13.

Kulthanan K, Subchookul C, Hunnangkul S, Chularojanamontri L, Tuchinda P . Factors Predicting the Response to Cyclosporin Treatment in Patients With Chronic Spontaneous Urticaria: A Systematic Review. Allergy Asthma Immunol Res. 2019; 11(5):736-755. PMC: 6658402. DOI: 10.4168/aair.2019.11.5.736. View

14.

Hsu C, Chiu S, Hong K, Saver J, Wu Y, Lee J . Folic Acid in Stroke Prevention in Countries without Mandatory Folic Acid Food Fortification: A Meta-Analysis of Randomized Controlled Trials. J Stroke. 2018; 20(1):99-109. PMC: 5836580. DOI: 10.5853/jos.2017.01522. View

15.

Nagendrababu V, Duncan H, Dummer P . International Endodontic Journal policy on mandatory prospective (a priori) protocol registration for clinical trials and systematic reviews. Int Endod J. 2021; 54(10):1685-1686. DOI: 10.1111/iej.13581. View

16.

Shea B, Reeves B, Wells G, Thuku M, Hamel C, Moran J . AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017; 358:j4008. PMC: 5833365. DOI: 10.1136/bmj.j4008. View

17.

Tsujimoto Y, Tsujimoto H, Kataoka Y, Kimachi M, Shimizu S, Ikenoue T . Majority of systematic reviews published in high-impact journals neglected to register the protocols: a meta-epidemiological study. J Clin Epidemiol. 2017; 84:54-60. DOI: 10.1016/j.jclinepi.2017.02.008. View

18.

Wang Q, Xiao Y, Guo T, Zhu H, Li J, Lai H . The use of GRADE approach in Cochrane reviews of TCM was insufficient: a cross-sectional survey. J Clin Epidemiol. 2021; 142:1-9. DOI: 10.1016/j.jclinepi.2021.11.004. View