Development and Validation of the Surgical Outcome Risk Tool (SORT)

Overview

Journal Br J Surg

Specialty General Surgery

Date 2014 Nov 13

PMID 25388883

Citations 82

Authors

K L Protopapa

J C Simpson

N C E Smith

S R Moonesinghe

Affiliations

Soon will be listed here.

Abstract

Background: Existing risk stratification tools have limitations and clinical experience suggests they are not used routinely. The aim of this study was to develop and validate a preoperative risk stratification tool to predict 30-day mortality after non-cardiac surgery in adults by analysis of data from the observational National Confidential Enquiry into Patient Outcome and Death (NCEPOD) Knowing the Risk study.

Methods: The data set was split into derivation and validation cohorts. Logistic regression was used to construct a model in the derivation cohort to create the Surgical Outcome Risk Tool (SORT), which was tested in the validation cohort.

Results: Prospective data for 19 097 cases in 326 hospitals were obtained from the NCEPOD study. Following exclusion of 2309, details of 16 788 patients were analysed (derivation cohort 11 219, validation cohort 5569). A model of 45 risk factors was refined on repeated regression analyses to develop a model comprising six variables: American Society of Anesthesiologists Physical Status (ASA-PS) grade, urgency of surgery (expedited, urgent, immediate), high-risk surgical specialty (gastrointestinal, thoracic, vascular), surgical severity (from minor to complex major), cancer and age 65 years or over. In the validation cohort, the SORT was well calibrated and demonstrated better discrimination than the ASA-PS and Surgical Risk Scale; areas under the receiver operating characteristic (ROC) curve were 0·91 (95 per cent c.i. 0·88 to 0·94), 0·87 (0·84 to 0·91) and 0·88 (0·84 to 0·92) respectively (P < 0·001).

Conclusion: The SORT allows rapid and simple data entry of six preoperative variables, and provides a percentage mortality risk for individuals undergoing surgery.

Citing Articles

Effect of intraoperative noise isolation on postoperative nausea and vomiting in patients undergoing gynecological laparoscopic surgery: protocol for a randomized controlled trial.

Fu C, Xia F, Yan Z, Xu H, Zhao W, Lei Y BMC Anesthesiol. 2025; 25(1):48.

PMID: 39885403 PMC: 11780904. DOI: 10.1186/s12871-025-02924-3.

Protocol for the impact of machine learning-based clinician decision support algorithims in perioperative care (IMAGINATIVE) in Singapore general hospital : a large prospective randomised controlled trial.

Abdullah H, Brenda T, Loh C, Ong M, Lamoureux E, Lim G BMJ Open. 2025; 14(12):e086769.

PMID: 39806608 PMC: 11667320. DOI: 10.1136/bmjopen-2024-086769.

Validation of the Korean version of defense and veterans pain rating scale for assessment of postoperative pain: a prospective observational cohort study.

Choi S, Kim T, Yoo H, Park S, Yoon S, Lee H Korean J Pain. 2024; 38(1):58-68.

PMID: 39734066 PMC: 11695251. DOI: 10.3344/kjp.24346.

Challenges and opportunities in enhanced recovery after surgery programs: An overview.

Gottumukkala V, Joshi G Indian J Anaesth. 2024; 68(11):951-958.

PMID: 39659530 PMC: 11626874. DOI: 10.4103/ija.ija_546_24.

[Preoperative risk prediction models for noncardiac surgery patients : Interpret and use risk scores correctly].

MPembele R, Roth S, Lurati Buse G Anaesthesiologie. 2024; 73(12):861-870.

PMID: 39576320 DOI: 10.1007/s00101-024-01481-7.

References

Turrentine F, Hanks J, Schirmer B, Stukenborg G . The relationship between body mass index and 30-day mortality risk, by principal surgical procedure. Arch Surg. 2011; 147(3):236-42. DOI: 10.1001/archsurg.2011.310. View

Hennis P, Meale P, Grocott M . Cardiopulmonary exercise testing for the evaluation of perioperative risk in non-cardiopulmonary surgery. Postgrad Med J. 2011; 87(1030):550-7. DOI: 10.1136/pgmj.2010.107185. View

Go A, Yang J, Ackerson L, Lepper K, Robbins S, Massie B . Hemoglobin level, chronic kidney disease, and the risks of death and hospitalization in adults with chronic heart failure: the Anemia in Chronic Heart Failure: Outcomes and Resource Utilization (ANCHOR) Study. Circulation. 2006; 113(23):2713-23. DOI: 10.1161/CIRCULATIONAHA.105.577577. View

Neary W, Prytherch D, Foy C, Heather B, Earnshaw J . Comparison of different methods of risk stratification in urgent and emergency surgery. Br J Surg. 2007; 94(10):1300-5. DOI: 10.1002/bjs.5809. View

Challand C, Struthers R, Sneyd J, Erasmus P, Mellor N, Hosie K . Randomized controlled trial of intraoperative goal-directed fluid therapy in aerobically fit and unfit patients having major colorectal surgery. Br J Anaesth. 2011; 108(1):53-62. DOI: 10.1093/bja/aer273. View

Moonesinghe S, Mythen M, Das P, Rowan K, Grocott M . Risk stratification tools for predicting morbidity and mortality in adult patients undergoing major surgery: qualitative systematic review. Anesthesiology. 2013; 119(4):959-81. DOI: 10.1097/ALN.0b013e3182a4e94d. View

Morris E, Taylor E, Thomas J, Quirke P, Finan P, Coleman M . Thirty-day postoperative mortality after colorectal cancer surgery in England. Gut. 2011; 60(6):806-13. DOI: 10.1136/gut.2010.232181. View

Gurgel S, Nascimento Jr P . Maintaining tissue perfusion in high-risk surgical patients: a systematic review of randomized clinical trials. Anesth Analg. 2010; 112(6):1384-91. DOI: 10.1213/ANE.0b013e3182055384. View

Gajdos C, Kile D, Hawn M, Finlayson E, Henderson W, Robinson T . Advancing age and 30-day adverse outcomes after nonemergent general surgeries. J Am Geriatr Soc. 2013; 61(9):1608-14. PMC: 4119758. DOI: 10.1111/jgs.12401. View

10.

Swets J . Measuring the accuracy of diagnostic systems. Science. 1988; 240(4857):1285-93. DOI: 10.1126/science.3287615. View

11.

Weiser T, Regenbogen S, Thompson K, Haynes A, Lipsitz S, Berry W . An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet. 2008; 372(9633):139-144. DOI: 10.1016/S0140-6736(08)60878-8. View

12.

Edwards M, Whittle J, Ackland G . Biomarkers to guide perioperative management. Postgrad Med J. 2011; 87(1030):542-9. DOI: 10.1136/pgmj.2010.107177. View

13.

James S, Jhanji S, Smith A, OBrien G, Fitzgibbon M, Pearse R . Comparison of the prognostic accuracy of scoring systems, cardiopulmonary exercise testing, and plasma biomarkers: a single-centre observational pilot study. Br J Anaesth. 2013; 112(3):491-7. DOI: 10.1093/bja/aet346. View

14.

Hendershot K, Robinson L, Roland J, Vaziri K, Rizzo A, Fakhry S . Estimated height, weight, and body mass index: implications for research and patient safety. J Am Coll Surg. 2006; 203(6):887-93. DOI: 10.1016/j.jamcollsurg.2006.08.018. View

15.

Wolters U, Wolf T, Stutzer H, Schroder T . ASA classification and perioperative variables as predictors of postoperative outcome. Br J Anaesth. 1996; 77(2):217-22. DOI: 10.1093/bja/77.2.217. View

16.

Ashwell M, Gunn P, Gibson S . Waist-to-height ratio is a better screening tool than waist circumference and BMI for adult cardiometabolic risk factors: systematic review and meta-analysis. Obes Rev. 2011; 13(3):275-86. DOI: 10.1111/j.1467-789X.2011.00952.x. View

17.

Lee T, Marcantonio E, Mangione C, Thomas E, Polanczyk C, Cook E . Derivation and prospective validation of a simple index for prediction of cardiac risk of major noncardiac surgery. Circulation. 1999; 100(10):1043-9. DOI: 10.1161/01.cir.100.10.1043. View

18.

Kartheuser A, Leonard D, Penninckx F, Paterson H, Brandt D, Remue C . Waist circumference and waist/hip ratio are better predictive risk factors for mortality and morbidity after colorectal surgery than body mass index and body surface area. Ann Surg. 2013; 258(5):722-30. DOI: 10.1097/SLA.0b013e3182a6605a. View

19.

Donati A, Loggi S, Preiser J, Orsetti G, Munch C, Gabbanelli V . Goal-directed intraoperative therapy reduces morbidity and length of hospital stay in high-risk surgical patients. Chest. 2007; 132(6):1817-24. DOI: 10.1378/chest.07-0621. View

20.

Pearse R, Harrison D, James P, Watson D, Hinds C, Rhodes A . Identification and characterisation of the high-risk surgical population in the United Kingdom. Crit Care. 2006; 10(3):R81. PMC: 1550954. DOI: 10.1186/cc4928. View