The Quality of Reports of Randomised Trials in 2000 and 2006: Comparative Study of Articles Indexed in PubMed

Overview

Journal BMJ

Specialty General Medicine

Date 2010 Mar 25

PMID 20332510

Citations 174

Authors

Sally Hopewell

Susan Dutton

Ly-Mee Yu

An-Wen Chan

Douglas G Altman

Affiliations

Soon will be listed here.

Abstract

Objectives: To examine the reporting characteristics and methodological details of randomised trials indexed in PubMed in 2000 and 2006 and assess whether the quality of reporting has improved after publication of the Consolidated Standards of Reporting Trials (CONSORT) Statement in 2001.

Design: Comparison of two cross sectional investigations. Study sample All primary reports of randomised trials indexed in PubMed in December 2000 (n=519) and December 2006 (n=616), including parallel group, crossover, cluster, factorial, and split body study designs.

Main Outcome Measures: The proportion of general and methodological items reported, stratified by year and study design. Risk ratios with 95% confidence intervals were calculated to represent changes in reporting between 2000 and 2006.

Results: The majority of trials were two arm (379/519 (73%) in 2000 v 468/616 (76%) in 2006) parallel group studies (383/519 (74%) v 477/616 (78%)) published in specialty journals (482/519 (93%) v 555/616 (90%)). In both 2000 and 2006, a median of 80 participants were recruited per trial for parallel group trials. The proportion of articles that reported drug trials decreased between 2000 and 2006 (from 393/519 (76%) to 356/616 (58%)), whereas the proportion of surgery trials increased (51/519 (10%) v 128/616 (21%)). There was an increase between 2000 and 2006 in the proportion of trial reports that included details of the primary outcome (risk ratio (RR) 1.18, 95% CI 1.04 to 1.33), sample size calculation (RR 1.66, 95% CI 1.40 to 1.95), and the methods of random sequence generation (RR 1.62, 95% CI 1.32 to 1.97) and allocation concealment (RR 1.40, 95% CI 1.11 to 1.76). There was no difference in the proportion of trials that provided specific details on who was blinded (RR 0.91, 95% CI 0.75 to 1.10).

Conclusions: Reporting of several important aspects of trial methods improved between 2000 and 2006; however, the quality of reporting remains well below an acceptable level. Without complete and transparent reporting of how a trial was designed and conducted, it is difficult for readers to assess its conduct and validity.

Citing Articles

Reporting guidelines for randomised controlled trial reports of implantable neurostimulation devices: the CONSORT-iNeurostim extension.

Duarte R, Bresnahan R, Copley S, Eldabe S, Thomson S, North R EClinicalMedicine. 2024; 78:102932.

PMID: 39606687 PMC: 11600657. DOI: 10.1016/j.eclinm.2024.102932.

Frequency of limitations statements in original research articles of United States leading medical journals: A meta-research protocol.

Hsu N, Tsai H, Hsu C, Tsai M, Liao C, Tokuda Y PLoS One. 2024; 19(11):e0305970.

PMID: 39485763 PMC: 11530002. DOI: 10.1371/journal.pone.0305970.

Evaluating Compliance of Randomized Controlled Trial Abstracts in Plastic Surgery Journals with CONSORT Guidelines Using GPT-4 AI.

Al Qurashi A, Hajja A, Alabdul Razzak G, Alkuwaity D, Chaudhri E, Alharbi R Plast Reconstr Surg Glob Open. 2024; 12(10):e6227.

PMID: 39399807 PMC: 11469817. DOI: 10.1097/GOX.0000000000006227.

Immersive Technologies for Depression Care: Scoping Review.

Mahony Reategui-Rivera C, Villarreal-Zegarra D, De la Cruz-Torralva K, Diaz-Sanchez P, Finkelstein J JMIR Ment Health. 2024; 11:e56056.

PMID: 38663004 PMC: 11082738. DOI: 10.2196/56056.

REporting quality of PilOt randomised controlled trials in surgery (REPORTS): a methodological survey protocol.

McKechnie T, Kazi T, Wang A, Zhang S, Thabane A, Nanji K BMJ Open. 2024; 14(4):e085293.

PMID: 38658008 PMC: 11043721. DOI: 10.1136/bmjopen-2024-085293.

References

Chan A, Altman D . Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005; 365(9465):1159-62. DOI: 10.1016/S0140-6736(05)71879-1. View

Boutron I, Moher D, Altman D, Schulz K, Ravaud P . Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008; 148(4):295-309. DOI: 10.7326/0003-4819-148-4-200802190-00008. View

Devereaux P, Choi P, El-Dika S, Bhandari M, Montori V, Schunemann H . An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004; 57(12):1232-6. DOI: 10.1016/j.jclinepi.2004.03.017. View

Gagnier J, DeMelo J, Boon H, Rochon P, Bombardier C . Quality of reporting of randomized controlled trials of herbal medicine interventions. Am J Med. 2006; 119(9):800.e1-11. DOI: 10.1016/j.amjmed.2006.02.006. View

Rios L, Odueyungbo A, Moitri M, Rahman M, Thabane L . Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008; 93(10):3810-6. DOI: 10.1210/jc.2008-0817. View

Juni P, Altman D, Egger M . Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001; 323(7303):42-6. PMC: 1120670. DOI: 10.1136/bmj.323.7303.42. View

Robinson K, Dickersin K . Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. Int J Epidemiol. 2002; 31(1):150-3. DOI: 10.1093/ije/31.1.150. View

Lai T, Wong V, Lam R, Cheng A, Lam D, Leung G . Quality of reporting of key methodological items of randomized controlled trials in clinical ophthalmic journals. Ophthalmic Epidemiol. 2007; 14(6):390-8. DOI: 10.1080/09286580701344399. View

Altman D . Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ. 2005; 330(7499):1056-7. PMC: 557224. DOI: 10.1136/bmj.330.7499.1056. View

10.

Mills E, Wu P, Gagnier J, Devereaux P . The quality of randomized trial reporting in leading medical journals since the revised CONSORT statement. Contemp Clin Trials. 2005; 26(4):480-7. DOI: 10.1016/j.cct.2005.02.008. View

11.

Soares H, Daniels S, Kumar A, Clarke M, Scott C, Swann S . Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004; 328(7430):22-4. PMC: 313900. DOI: 10.1136/bmj.328.7430.22. View

12.

Anttila H, Malmivaara A, Kunz R, Autti-Ramo I, Makela M . Quality of reporting of randomized, controlled trials in cerebral palsy. Pediatrics. 2006; 117(6):2222-30. DOI: 10.1542/peds.2005-1630. View

13.

Hollis S, Campbell F . What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999; 319(7211):670-4. PMC: 28218. DOI: 10.1136/bmj.319.7211.670. View

14.

Scales Jr C, Norris R, Preminger G, Vieweg J, Peterson B, Dahm P . Evaluating the evidence: statistical methods in randomized controlled trials in the urological literature. J Urol. 2008; 180(4):1463-7. DOI: 10.1016/j.juro.2008.06.026. View

15.

Pienaar E, Volmink J, Zwarenstein M, Swingler G . Randomised trials in the South African Medical Journal, 1948-1997. S Afr Med J. 2003; 92(11):901-3. View

16.

Plint A, Moher D, Morrison A, Schulz K, Altman D, Hill C . Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006; 185(5):263-7. DOI: 10.5694/j.1326-5377.2006.tb00557.x. View

17.

Chan A, Hrobjartsson A, Jorgensen K, Gotzsche P, Altman D . Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. BMJ. 2008; 337:a2299. PMC: 2600604. DOI: 10.1136/bmj.a2299. View

18.

Wang G, Mao B, Xiong Z, Fan T, Chen X, Wang L . The quality of reporting of randomized controlled trials of traditional Chinese medicine: a survey of 13 randomly selected journals from mainland China. Clin Ther. 2007; 29(7):1456-67. DOI: 10.1016/j.clinthera.2007.07.023. View

19.

Gravel J, Opatrny L, Shapiro S . The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?. Clin Trials. 2007; 4(4):350-6. DOI: 10.1177/1740774507081223. View

20.

Altman D, Schulz K, Moher D, Egger M, Davidoff F, Elbourne D . The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001; 134(8):663-94. DOI: 10.7326/0003-4819-134-8-200104170-00012. View