Systematic Review and Meta-analysis of Mortality Risk Prediction Models in Adult Cardiac Surgery

Overview

Journal Interact Cardiovasc Thorac Surg

Publisher Oxford University Press

Specialties Cardiology & Vascular Diseases
General Surgery
Pulmonary Medicine

Date 2021 May 27

PMID 34041539

Citations 4

Authors

Shubhra Sinha

Arnaldo Dimagli

Lauren Dixon

Mario Gaudino

Massimo Caputo

Hunaid A Vohra

Gianni Angelini

Umberto Benedetto

Affiliations

Soon will be listed here.

Abstract

Objectives: The most used mortality risk prediction models in cardiac surgery are the European System for Cardiac Operative Risk Evaluation (ES) and Society of Thoracic Surgeons (STS) score. There is no agreement on which score should be considered more accurate nor which score should be utilized in each population subgroup. We sought to provide a thorough quantitative assessment of these 2 models.

Methods: We performed a systematic literature review and captured information on discrimination, as quantified by the area under the receiver operator curve (AUC), and calibration, as quantified by the ratio of observed-to-expected mortality (O:E). We performed random effects meta-analysis of the performance of the individual models as well as pairwise comparisons and subgroup analysis by procedure type, time and continent.

Results: The ES2 {AUC 0.783 [95% confidence interval (CI) 0.765-0.800]; O:E 1.102 (95% CI 0.943-1.289)} and STS [AUC 0.757 (95% CI 0.727-0.785); O:E 1.111 (95% CI 0.853-1.447)] showed good overall discrimination and calibration. There was no significant difference in the discrimination of the 2 models (difference in AUC -0.016; 95% CI -0.034 to -0.002; P = 0.09). However, the calibration of ES2 showed significant geographical variations (P < 0.001) and a trend towards miscalibration with time (P=0.057). This was not seen with STS.

Conclusions: ES2 and STS are reliable predictors of short-term mortality following adult cardiac surgery in the populations from which they were derived. STS may have broader applications when comparing outcomes across continents as compared to ES2.

Registration: Prospero (https://www.crd.york.ac.uk/PROSPERO/) CRD42020220983.

Citing Articles

Effect of early administration of tetracosactide on mortality and host response in critically ill patients requiring rescue surgery: a sensitivity analysis of the STOPSHOCK phase 3 randomized controlled trial.

Noera G, Bertolini A, Calza L, Gori M, Pitino A, DArrigo G Mil Med Res. 2024; 11(1):56.

PMID: 39160574 PMC: 11331742. DOI: 10.1186/s40779-024-00555-2.

Comparison of machine learning techniques in prediction of mortality following cardiac surgery: analysis of over 220 000 patients from a large national database.

Sinha S, Dong T, Dimagli A, Vohra H, Holmes C, Benedetto U Eur J Cardiothorac Surg. 2023; 63(6).

PMID: 37154705 PMC: 10275911. DOI: 10.1093/ejcts/ezad183.

Periprocedural adverse events after revascularisation: the importance of getting off to a good start.

Gaudino M, Dimagli A EuroIntervention. 2023; 18(15):1220-1221.

PMID: 36939104 PMC: 10015292. DOI: 10.4244/EIJ-E-22-00054.

The performance of EuroSCORE II in CABG patients in relation to sex, age, and surgical risk: a nationwide study in 14,118 patients.

Silverborn M, Nielsen S, Karlsson M J Cardiothorac Surg. 2023; 18(1):40.

PMID: 36658617 PMC: 9850511. DOI: 10.1186/s13019-023-02141-4.

References

Shahian D, OBrien S, Filardo G, Ferraris V, Haan C, Rich J . The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1--coronary artery bypass grafting surgery. Ann Thorac Surg. 2009; 88(1 Suppl):S2-22. DOI: 10.1016/j.athoracsur.2009.05.053. View

Barili F, Pacini D, Grossi C, Di Bartolomeo R, Alamanni F, Parolari A . Reliability of new scores in predicting perioperative mortality after mitral valve surgery. J Thorac Cardiovasc Surg. 2013; 147(3):1008-12. DOI: 10.1016/j.jtcvs.2013.06.042. View

Garcia-Valentin A, Mestres C, Bernabeu E, Bahamonde J, Martin I, Rueda C . Validation and quality measurements for EuroSCORE and EuroSCORE II in the Spanish cardiac surgical population: a prospective, multicentre study. Eur J Cardiothorac Surg. 2015; 49(2):399-405. DOI: 10.1093/ejcts/ezv090. View

Chalmers J, Pullan M, Fabri B, McShane J, Shaw M, Mediratta N . Validation of EuroSCORE II in a modern cohort of patients undergoing cardiac surgery. Eur J Cardiothorac Surg. 2012; 43(4):688-94. DOI: 10.1093/ejcts/ezs406. View

Shahian D, Jacobs J, Badhwar V, Kurlansky P, Furnary A, Cleveland Jr J . The Society of Thoracic Surgeons 2018 Adult Cardiac Surgery Risk Models: Part 1-Background, Design Considerations, and Model Development. Ann Thorac Surg. 2018; 105(5):1411-1418. DOI: 10.1016/j.athoracsur.2018.03.002. View

Biancari F, Vasques F, Mikkola R, Martin M, Lahtinen J, Heikkinen J . Validation of EuroSCORE II in patients undergoing coronary artery bypass surgery. Ann Thorac Surg. 2012; 93(6):1930-5. DOI: 10.1016/j.athoracsur.2012.02.064. View

Grant S, Grayson A, Jackson M, Au J, Fabri B, Grotte G . Does the choice of risk-adjustment model influence the outcome of surgeon-specific mortality analysis? A retrospective analysis of 14,637 patients under 31 surgeons. Heart. 2007; 94(8):1044-9. DOI: 10.1136/hrt.2006.110478. View

van Gameren M, Kappetein A, Steyerberg E, Venema A, Berenschot E, Hannan E . Do we need separate risk stratification models for hospital mortality after heart valve surgery?. Ann Thorac Surg. 2008; 85(3):921-30. DOI: 10.1016/j.athoracsur.2007.11.074. View

Tiveron M, Bomfim H, Simplicio M, Bergonso M, Matos M, Ferreira S . Performance of InsCor and three international scores in cardiac surgery at Santa Casa de Marília. Rev Bras Cir Cardiovasc. 2015; 30(1):1-8. PMC: 4389514. DOI: 10.5935/1678-9741.20140116. View

10.

Shanmugam G, West M, Berg G . Additive and logistic EuroSCORE performance in high risk patients. Interact Cardiovasc Thorac Surg. 2007; 4(4):299-303. DOI: 10.1510/icvts.2004.104042. View

11.

van Straten A, Tan E, Hamad M, Martens E, Van Zundert A . Evaluation of the EuroSCORE risk scoring model for patients undergoing coronary artery bypass graft surgery: a word of caution. Neth Heart J. 2010; 18(7-8):355-9. PMC: 2922781. DOI: 10.1007/BF03091791. View

12.

Chan V, Ahrari A, Ruel M, Elmistekawy E, Hynes M, Mesana T . Perioperative deaths after mitral valve operations may be overestimated by contemporary risk models. Ann Thorac Surg. 2014; 98(2):605-10. DOI: 10.1016/j.athoracsur.2014.05.011. View

13.

Di Dedda U, Pelissero G, Agnelli B, De Vincentiis C, Castelvecchio S, Ranucci M . Accuracy, calibration and clinical performance of the new EuroSCORE II risk stratification system. Eur J Cardiothorac Surg. 2012; 43(1):27-32. DOI: 10.1093/ejcts/ezs196. View

14.

Nashef S, Roques F, Sharples L, Nilsson J, Smith C, Goldstone A . EuroSCORE II. Eur J Cardiothorac Surg. 2012; 41(4):734-44. DOI: 10.1093/ejcts/ezs043. View

15.

Sullivan P, Wallach J, Ioannidis J . Meta-Analysis Comparing Established Risk Prediction Models (EuroSCORE II, STS Score, and ACEF Score) for Perioperative Mortality During Cardiac Surgery. Am J Cardiol. 2016; 118(10):1574-1582. DOI: 10.1016/j.amjcard.2016.08.024. View

16.

Moher D, Liberati A, Tetzlaff J, Altman D . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009; 6(7):e1000097. PMC: 2707599. DOI: 10.1371/journal.pmed.1000097. View

17.

Luc J, Graham M, Norris C, Al Shouli S, Nijjar Y, Meyer S . Predicting operative mortality in octogenarians for isolated coronary artery bypass grafting surgery: a retrospective study. BMC Cardiovasc Disord. 2017; 17(1):275. PMC: 5667481. DOI: 10.1186/s12872-017-0706-z. View

18.

Nishida T, Sonoda H, Oishi Y, Tanoue Y, Nakashima A, Shiokawa Y . The novel EuroSCORE II algorithm predicts the hospital mortality of thoracic aortic surgery in 461 consecutive Japanese patients better than both the original additive and logistic EuroSCORE algorithms. Interact Cardiovasc Thorac Surg. 2013; 18(4):446-50. PMC: 3957283. DOI: 10.1093/icvts/ivt524. View

19.

Hogervorst E, Rosseel P, van de Watering L, Brand A, Bentala M, van der Meer B . Prospective validation of the EuroSCORE II risk model in a single Dutch cardiac surgery centre. Neth Heart J. 2018; 26(11):540-551. PMC: 6220016. DOI: 10.1007/s12471-018-1161-x. View

20.

Debray T, Damen J, Riley R, Snell K, Reitsma J, Hooft L . A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes. Stat Methods Med Res. 2018; 28(9):2768-2786. PMC: 6728752. DOI: 10.1177/0962280218785504. View