Poor Reporting Quality of Randomized Controlled Trials Comparing Treatments of COVID-19-A Retrospective Cross-sectional Study on the First Year of Publications

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2023 Oct 16

PMID 37844082

Authors

Linda Grusser

Charlotte Eissing

Ana Kowark

Andras P Keszei

Julia Wallqvist

Rolf Rossaint

Sebastian Ziemann

Affiliations

Soon will be listed here.

Abstract

Introduction: Transparent and complete reporting of randomized controlled trials (RCTs) is essential for critical scientific appraisal of the results. It has been argued whether publications during the COVID-19 pandemic have met reporting standards. In this study, we assessed reporting adherence of RCTs on treatment interventions in COVID-19 patients to the CONSORT checklist and discuss which lessons can be learned to improve reporting in the future.

Methods: This was a retrospective, cross-sectional study performed at the University Hospital RWTH Aachen, Germany. We conducted a pragmatic systematic literature search in the PubMed database to identify RCTs on treatment interventions in COVID-19 patients in the first year of publications on the topic (March 2020-February 2021). We investigated the adherence of each publication to the CONSORT checklist and assessed the association between specific predictors and percentage adherence in an exploratory multivariable regression model.

Results: We analyzed 127 RCTs and found that the median percentage adherence to the CONSORT checklist was 54.3% [IQR 38.9 to 65.7]. In the exploratory multivariable regression model, the impact factor (highest tertile of impact factor compared to lowest tertile ß = 21.77, 95% CI 13.89 to 29.66, p<0.001; middle tertile compared lowest tertile ß = 11.79, 95% CI 5.74 to 17.84, p<0.001)) and authors' referral to the CONSORT statement (ß = 9.29, 95% CI 2.98 to 15.60, p = 0.004) were associated with a higher percentage adherence to the CONSORT checklist.

Conclusion: The reporting quality of RCTs on treatment interventions in COVID-19 patients during the first year of publications was poor. Measures to improve reporting quality are urgently needed.

References

Moher D, Schulz K, Altman D . The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001; 285(15):1987-91. DOI: 10.1001/jama.285.15.1987. View

BATH F, Owen V, Bath P . Quality of full and final publications reporting acute stroke trials: a systematic review. Stroke. 1998; 29(10):2203-10. DOI: 10.1161/01.str.29.10.2203. View

Bramstedt K . The carnage of substandard research during the COVID-19 pandemic: a call for quality. J Med Ethics. 2020; 46(12):803-807. DOI: 10.1136/medethics-2020-106494. View

Turner L, Shamseer L, Altman D, Weeks L, Peters J, Kober T . Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012; 11:MR000030. PMC: 7386818. DOI: 10.1002/14651858.MR000030.pub2. View

von Elm E, Altman D, Egger M, Pocock S, Gotzsche P, Vandenbroucke J . The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007; 370(9596):1453-7. DOI: 10.1016/S0140-6736(07)61602-X. View

Heneghan C, Mahtani K, Goldacre B, Godlee F, Macdonald H, Jarvies D . Evidence based medicine manifesto for better healthcare. BMJ. 2017; 357:j2973. DOI: 10.1136/bmj.j2973. View

Munter N, Stevanovic A, Rossaint R, Stoppe C, Sanders R, Coburn M . CONSORT item adherence in top ranked anaesthesiology journals in 2011: a retrospective analysis. Eur J Anaesthesiol. 2014; 32(2):117-25. DOI: 10.1097/EJA.0000000000000176. View

Schulz K, Chalmers I, Hayes R, Altman D . Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995; 273(5):408-12. DOI: 10.1001/jama.273.5.408. View

Rennie D . CONSORT revised--improving the reporting of randomized trials. JAMA. 2001; 285(15):2006-7. DOI: 10.1001/jama.285.15.2006. View

10.

Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I . Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996; 276(8):637-9. DOI: 10.1001/jama.276.8.637. View

11.

Stevanovic A, Schmitz S, Rossaint R, Schurholz T, Coburn M . CONSORT item reporting quality in the top ten ranked journals of critical care medicine in 2011: a retrospective analysis. PLoS One. 2015; 10(5):e0128061. PMC: 4447424. DOI: 10.1371/journal.pone.0128061. View

12.

Peyrin-Biroulet L . Will the Quality of Research Remain the Same During the COVID-19 Pandemic?. Clin Gastroenterol Hepatol. 2020; 18(9):2142. PMC: 7270723. DOI: 10.1016/j.cgh.2020.03.054. View

13.

Yin Y, Shi F, Zhang Y, Zhang X, Ye J, Zhang J . Evaluation of reporting quality of randomized controlled trials in patients with COVID-19 using the CONSORT statement. PLoS One. 2021; 16(9):e0257093. PMC: 8460279. DOI: 10.1371/journal.pone.0257093. View

14.

Devereaux P, Choi P, El-Dika S, Bhandari M, Montori V, Schunemann H . An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004; 57(12):1232-6. DOI: 10.1016/j.jclinepi.2004.03.017. View

15.

Wilczynski N, McKibbon K, Walter S, Garg A, Haynes R . MEDLINE clinical queries are robust when searching in recent publishing years. J Am Med Inform Assoc. 2012; 20(2):363-8. PMC: 3638187. DOI: 10.1136/amiajnl-2012-001075. View

16.

Haynes R, McKibbon K, Wilczynski N, Walter S, Werre S . Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey. BMJ. 2005; 330(7501):1179. PMC: 558012. DOI: 10.1136/bmj.38446.498542.8F. View

17.

Page M, McKenzie J, Bossuyt P, Boutron I, Hoffmann T, Mulrow C . The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021; 372:n71. PMC: 8005924. DOI: 10.1136/bmj.n71. View

18.

Ziemann S, Paetzolt I, Grusser L, Coburn M, Rossaint R, Kowark A . Poor reporting quality of observational clinical studies comparing treatments of COVID-19 - a retrospective cross-sectional study. BMC Med Res Methodol. 2022; 22(1):23. PMC: 8771183. DOI: 10.1186/s12874-021-01501-9. View

19.

Yin Y, Gao J, Zhang Y, Zhang X, Ye J, Zhang J . Evaluation of reporting quality of abstracts of randomized controlled trials regarding patients with COVID-19 using the CONSORT statement for abstracts. Int J Infect Dis. 2022; 116:122-129. PMC: 8736283. DOI: 10.1016/j.ijid.2022.01.002. View

20.

Jung R, Di Santo P, Clifford C, Prosperi-Porta G, Skanes S, Hung A . Methodological quality of COVID-19 clinical research. Nat Commun. 2021; 12(1):943. PMC: 7878793. DOI: 10.1038/s41467-021-21220-5. View