A Multivariate Model for Successful Publication of Intensive Care Medicine Randomized Controlled Trials in the Highest Impact Factor Journals: the SCOTI Score

Overview

Journal Ann Intensive Care

Specialty Critical Care

Date 2021 Nov 27

PMID 34837580

Citations 2

Authors

Joris Pensier

Audrey De Jong

Gerald Chanques

Emmanuel Futier

Elie Azoulay

Nicolas Molinari

Samir Jaber

Affiliations

Soon will be listed here.

Abstract

Background: Critical care randomized controlled trials (RCTs) are often published in high-impact journals, whether general journals [the New England Journal of Medicine (NEJM), The Lancet, the Journal of the American Medical Association (JAMA)] or critical care journals [Intensive Care Medicine (ICM), the American Journal of Respiratory and Critical Care Medicine (AJRCCM), Critical Care Medicine (CCM)]. As rejection occurs in up to 97% of cases, it might be appropriate to assess pre-submission probability of being published. The objective of this study was to develop and internally validate a simplified score predicting whether an ongoing trial stands a chance of being published in high-impact general journals.

Methods: A cohort of critical care RCTs published between 1999 and 2018 in the three highest impact medical journals (NEJM, The Lancet, JAMA) or the three highest impact critical care journals (ICM, AJRCCM, CCM) was split into two samples (derivation cohort, validation cohort) to develop and internally validate the simplified score. Primary outcome was journal of publication assessed as high-impact general journal (NEJM, The Lancet, JAMA) or critical care journal (ICM, AJRCCM, CCM).

Results: A total of 968 critical care RCTs were included in the predictive cohort and split into a derivation cohort (n = 510) and a validation cohort (n = 458). In the derivation cohort, the sample size (P value < 0.001), the number of centers involved (P value = 0.01), mortality as primary outcome (P value = 0.002) or a composite item including mortality as primary outcome (P value = 0.004), and topic [ventilation (P value < 0.001) or miscellaneous (P value < 0.001)] were independent factors predictive of publication in high-impact general journals, compared to high-impact critical care journals. The SCOTI score (Sample size, Centers, Outcome, Topic, and International score) was developed with an area under the ROC curve of 0.84 (95% Confidence Interval, 0.80-0.88) in validation by split sample.

Conclusions: The SCOTI score, developed and validated by split sample, accurately predicts the chances of a critical care RCT being published in high-impact general journals, compared to high-impact critical care journals.

Citing Articles

Manuscript publication of abstracts presented at gynecologic surgery societies' annual meetings.

Fitzsimmons K, Hamilton K, Schneyer R, Toussia-Cohen S, Fan S, Farsa N Arch Gynecol Obstet. 2025; .

PMID: 39821422 DOI: 10.1007/s00404-024-07865-9.

Noninvasive respiratory support following extubation in critically ill adults with obesity: a systematic review and network meta-analysis.

Pensier J, Naudet-Lasserre A, Monet C, Capdevila M, Aarab Y, Lakbar I EClinicalMedicine. 2025; 79():103002.

PMID: 39791108 PMC: 11715126. DOI: 10.1016/j.eclinm.2024.103002.

Noninvasive ventilation on reintubation in patients with obesity and hypoxemic respiratory failure following abdominal surgery: a post hoc analysis of a randomized clinical trial.

Jaber S, Pensier J, Futier E, Paugam-Burtz C, Seguin P, Ferrandiere M Intensive Care Med. 2024; 50(8):1265-1274.

PMID: 39073580 DOI: 10.1007/s00134-024-07522-4.

Outcomes and time trends of acute respiratory distress syndrome patients with and without liver cirrhosis: an observational cohort.

Pensier J, De Jong A, Monet C, Aarab Y, Le Bihan C, Capdevila M Ann Intensive Care. 2023; 13(1):96.

PMID: 37773241 PMC: 10541379. DOI: 10.1186/s13613-023-01190-1.

References

Santacruz C, Pereira A, Celis E, Vincent J . Which Multicenter Randomized Controlled Trials in Critical Care Medicine Have Shown Reduced Mortality? A Systematic Review. Crit Care Med. 2019; 47(12):1680-1691. DOI: 10.1097/CCM.0000000000004000. View

Latronico N, Botteri M, Minelli C, Zanotti C, Bertolini G, Candiani A . Quality of reporting of randomised controlled trials in the intensive care literature. A systematic analysis of papers published in Intensive Care Medicine over 26 years. Intensive Care Med. 2002; 28(9):1316-23. DOI: 10.1007/s00134-002-1339-x. View

Jaber S, Lescot T, Futier E, Paugam-Burtz C, Seguin P, Ferrandiere M . Effect of Noninvasive Ventilation on Tracheal Reintubation Among Patients With Hypoxemic Respiratory Failure Following Abdominal Surgery: A Randomized Clinical Trial. JAMA. 2016; 315(13):1345-53. DOI: 10.1001/jama.2016.2706. View

Duffett M, Choong K, Hartling L, Menon K, Thabane L, Cook D . Randomized controlled trials in pediatric critical care: a scoping review. Crit Care. 2013; 17(5):R256. PMC: 4057256. DOI: 10.1186/cc13083. View

Latronico N, Metelli M, Turin M, Piva S, Rasulo F, Minelli C . Quality of reporting of randomized controlled trials published in Intensive Care Medicine from 2001 to 2010. Intensive Care Med. 2013; 39(8):1386-95. DOI: 10.1007/s00134-013-2947-3. View

Ospina-Tascon G, Buchele G, Vincent J . Multicenter, randomized, controlled trials evaluating mortality in intensive care: doomed to fail?. Crit Care Med. 2008; 36(4):1311-22. DOI: 10.1097/CCM.0b013e318168ea3e. View

Annane D, Sebille V, Charpentier C, Bollaert P, Francois B, Korach J . Effect of treatment with low doses of hydrocortisone and fludrocortisone on mortality in patients with septic shock. JAMA. 2002; 288(7):862-71. DOI: 10.1001/jama.288.7.862. View

Papazian L, Forel J, Gacouin A, Penot-Ragon C, Perrin G, Loundou A . Neuromuscular blockers in early acute respiratory distress syndrome. N Engl J Med. 2010; 363(12):1107-16. DOI: 10.1056/NEJMoa1005372. View

Elliott J, Bodinier B, Bond T, Chadeau-Hyam M, Evangelou E, Moons K . Predictive Accuracy of a Polygenic Risk Score-Enhanced Prediction Model vs a Clinical Risk Score for Coronary Artery Disease. JAMA. 2020; 323(7):636-645. PMC: 7042853. DOI: 10.1001/jama.2019.22241. View

10.

Fraser G, Stram D . Regression calibration in studies with correlated variables measured with error. Am J Epidemiol. 2001; 154(9):836-44. DOI: 10.1093/aje/154.9.836. View

11.

Murray S, Heathers J, Schauer R, Griffiths S, Mitchison D, Mond J . Postpublication Metrics of Randomized Clinical Trials With and Without Null Findings. JAMA. 2019; 321(18):1825-1826. PMC: 6518340. DOI: 10.1001/jama.2019.2994. View

12.

Moher D, Schulz K, Altman D . The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001; 285(15):1987-91. DOI: 10.1001/jama.285.15.1987. View

13.

Harhay M, Wagner J, Ratcliffe S, Bronheim R, Gopal A, Green S . Outcomes and statistical power in adult critical care randomized trials. Am J Respir Crit Care Med. 2014; 189(12):1469-78. PMC: 4226016. DOI: 10.1164/rccm.201401-0056CP. View

14.

. Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992; 268(17):2420-5. DOI: 10.1001/jama.1992.03490170092032. View

15.

De Jong A, Molinari N, Terzi N, Mongardon N, Arnal J, Guitton C . Early identification of patients at risk for difficult intubation in the intensive care unit: development and validation of the MACOCHA score in a multicenter cohort study. Am J Respir Crit Care Med. 2013; 187(8):832-9. DOI: 10.1164/rccm.201210-1851OC. View

16.

Collins G, Reitsma J, Altman D, Moons K . Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015; 350:g7594. DOI: 10.1136/bmj.g7594. View

17.

Bellani G, Laffey J, Pham T, Fan E, Brochard L, Esteban A . Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 Countries. JAMA. 2016; 315(8):788-800. DOI: 10.1001/jama.2016.0291. View

18.

Garfield E . The history and meaning of the journal impact factor. JAMA. 2006; 295(1):90-3. DOI: 10.1001/jama.295.1.90. View

19.

Leisman D, Harhay M, Lederer D, Abramson M, Adjei A, Bakker J . Development and Reporting of Prediction Models: Guidance for Authors From Editors of Respiratory, Sleep, and Critical Care Journals. Crit Care Med. 2020; 48(5):623-633. PMC: 7161722. DOI: 10.1097/CCM.0000000000004246. View

20.

Okike K, Kocher M, Mehlman C, Heckman J, Bhandari M . Nonscientific factors associated with acceptance for publication in The Journal of Bone and Joint Surgery (American Volume). J Bone Joint Surg Am. 2008; 90(11):2432-7. PMC: 2663327. DOI: 10.2106/JBJS.G.01687. View