SOFA Score Performs Worse Than Age for Predicting Mortality in Patients with COVID-19

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2024 May 17

PMID 38758942

Authors

Raphael A G Sherak

Hoomaan Sajjadi

Naveed Khimani

Benjamin Tolchin

Karen Jubanyik

R Andrew Taylor

Wade Schulz

Bobak J Mortazavi

Adrian D Haimovich

Affiliations

Soon will be listed here.

Abstract

The use of the Sequential Organ Failure Assessment (SOFA) score, originally developed to describe disease morbidity, is commonly used to predict in-hospital mortality. During the COVID-19 pandemic, many protocols for crisis standards of care used the SOFA score to select patients to be deprioritized due to a low likelihood of survival. A prior study found that age outperformed the SOFA score for mortality prediction in patients with COVID-19, but was limited to a small cohort of intensive care unit (ICU) patients and did not address whether their findings were unique to patients with COVID-19. Moreover, it is not known how well these measures perform across races. In this retrospective study, we compare the performance of age and SOFA score in predicting in-hospital mortality across two cohorts: a cohort of 2,648 consecutive adult patients diagnosed with COVID-19 who were admitted to a large academic health system in the northeastern United States over a 4-month period in 2020 and a cohort of 75,601 patients admitted to one of 335 ICUs in the eICU database between 2014 and 2015. We used age and the maximum SOFA score as predictor variables in separate univariate logistic regression models for in-hospital mortality and calculated area under the receiver operator characteristic curves (AU-ROCs) and area under precision-recall curves (AU-PRCs) for each predictor in both cohorts. Among the COVID-19 cohort, age (AU-ROC 0.795, 95% CI 0.762, 0.828) had a significantly better discrimination than SOFA score (AU-ROC 0.679, 95% CI 0.638, 0.721) for mortality prediction. Conversely, age (AU-ROC 0.628 95% CI 0.608, 0.628) underperformed compared to SOFA score (AU-ROC 0.735, 95% CI 0.726, 0.745) in non-COVID-19 ICU patients in the eICU database. There was no difference between Black and White COVID-19 patients in performance of either age or SOFA Score. Our findings bring into question the utility of SOFA score-based resource allocation in COVID-19 crisis standards of care.

Citing Articles

External Validation of the Predictive Accuracy of Clinical and Immunological Scores in COVID-19 Outcomes in a Retrospective Cohort Study.

Tanase A, Petrescu E, Hoinoiu T, Bojoga D, Timar B Biomedicines. 2024; 12(11).

PMID: 39595061 PMC: 11592211. DOI: 10.3390/biomedicines12112495.

Association between Age-Adjusted Endothelial Activation and Stress Index and Intensive Care Unit Mortality in Patients with Severe COVID-19.

Jeong J, Heo M, Park S, Lee S, Park O, Kim T Tuberc Respir Dis (Seoul). 2024; 87(4):524-531.

PMID: 39044336 PMC: 11468444. DOI: 10.4046/trd.2024.0081.

References

Wiersinga W, Rhodes A, Cheng A, Peacock S, Prescott H . Pathophysiology, Transmission, Diagnosis, and Treatment of Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020; 324(8):782-793. DOI: 10.1001/jama.2020.12839. View

Shahpori R, Stelfox H, Doig C, Boiteau P, Zygun D . Sequential Organ Failure Assessment in H1N1 pandemic planning. Crit Care Med. 2011; 39(4):827-32. DOI: 10.1097/CCM.0b013e318206d548. View

Raith E, Udy A, Bailey M, McGloughlin S, Macisaac C, Bellomo R . Prognostic Accuracy of the SOFA Score, SIRS Criteria, and qSOFA Score for In-Hospital Mortality Among Adults With Suspected Infection Admitted to the Intensive Care Unit. JAMA. 2017; 317(3):290-300. DOI: 10.1001/jama.2016.20328. View

Miller W, Han X, Peek M, Ashana D, Parker W . Accuracy of the Sequential Organ Failure Assessment Score for In-Hospital Mortality by Race and Relevance to Crisis Standards of Care. JAMA Netw Open. 2021; 4(6):e2113891. PMC: 8214156. DOI: 10.1001/jamanetworkopen.2021.13891. View

Pollard T, Johnson A, Raffa J, Celi L, Mark R, Badawi O . The eICU Collaborative Research Database, a freely available multi-center database for critical care research. Sci Data. 2018; 5:180178. PMC: 6132188. DOI: 10.1038/sdata.2018.178. View

Vickers A, Elkin E . Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006; 26(6):565-74. PMC: 2577036. DOI: 10.1177/0272989X06295361. View

Jones A, Trzeciak S, Kline J . The Sequential Organ Failure Assessment score for predicting outcome in patients with severe sepsis and evidence of hypoperfusion at the time of emergency department presentation. Crit Care Med. 2009; 37(5):1649-54. PMC: 2703722. DOI: 10.1097/CCM.0b013e31819def97. View

Kovach C, Fletcher G, Rudd K, Grant R, Carlbom D . Comparative prognostic accuracy of sepsis scores for hospital mortality in adults with suspected infection in non-ICU and ICU at an academic public hospital. PLoS One. 2019; 14(9):e0222563. PMC: 6746500. DOI: 10.1371/journal.pone.0222563. View

Hick J, Hanfling D, Wynia M . Hospital Planning for Contingency and Crisis Conditions: Crisis Standards of Care Lessons from COVID-19. Jt Comm J Qual Patient Saf. 2022; 48(6-7):354-361. PMC: 8828442. DOI: 10.1016/j.jcjq.2022.02.003. View

10.

Tolchin B, Oladele C, Galusha D, Kashyap N, Showstark M, Bonito J . Racial disparities in the SOFA score among patients hospitalized with COVID-19. PLoS One. 2021; 16(9):e0257608. PMC: 8448580. DOI: 10.1371/journal.pone.0257608. View

11.

Tolchin B, Hull S, Kraschel K . Triage and justice in an unjust pandemic: ethical allocation of scarce medical resources in the setting of racial and socioeconomic disparities. J Med Ethics. 2020; . DOI: 10.1136/medethics-2020-106457. View

12.

Egede L, Walker R . Structural Racism, Social Risk Factors, and Covid-19 - A Dangerous Convergence for Black Americans. N Engl J Med. 2020; 383(12):e77. PMC: 7747672. DOI: 10.1056/NEJMp2023616. View

13.

Kashyap R, Sherani K, Dutt T, Gnanapandithan K, Sagar M, Vallabhajosyula S . Current Utility of Sequential Organ Failure Assessment Score: A Literature Review and Future Directions. Open Respir Med J. 2021; 15:1-6. PMC: 8227444. DOI: 10.2174/1874306402115010001. View

14.

Sarkar R, Martin C, Mattie H, Wawira Gichoya J, Stone D, Celi L . Performance of intensive care unit severity scoring systems across different ethnicities in the USA: a retrospective observational study. Lancet Digit Health. 2021; 3(4):e241-e249. PMC: 8063502. DOI: 10.1016/S2589-7500(21)00022-4. View

15.

Minne L, Abu-Hanna A, de Jonge E . Evaluation of SOFA-based models for predicting mortality in the ICU: A systematic review. Crit Care. 2008; 12(6):R161. PMC: 2646326. DOI: 10.1186/cc7160. View

16.

Vincent J, Moreno R, Takala J, Willatts S, de Mendonca A, Bruining H . The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996; 22(7):707-10. DOI: 10.1007/BF01709751. View

17.

White D, Lo B . A Framework for Rationing Ventilators and Critical Care Beds During the COVID-19 Pandemic. JAMA. 2020; 323(18):1773-1774. DOI: 10.1001/jama.2020.5046. View

18.

Ashana D, Anesi G, Liu V, Escobar G, Chesley C, Eneanya N . Equitably Allocating Resources during Crises: Racial Differences in Mortality Prediction Models. Am J Respir Crit Care Med. 2021; 204(2):178-186. PMC: 8759151. DOI: 10.1164/rccm.202012-4383OC. View

19.

Cardenas-Turanzas M, Ensor J, Wakefield C, Zhang K, Wallace S, Price K . Cross-validation of a Sequential Organ Failure Assessment score-based model to predict mortality in patients with cancer admitted to the intensive care unit. J Crit Care. 2012; 27(6):673-80. DOI: 10.1016/j.jcrc.2012.04.018. View

20.

Yu S, Leung S, Heo M, Soto G, Shah R, Gunda S . Comparison of risk prediction scoring systems for ward patients: a retrospective nested case-control study. Crit Care. 2014; 18(3):R132. PMC: 4227284. DOI: 10.1186/cc13947. View