Risk Scores in Anaesthesia: the Future is Hard to Predict

Overview

Journal BJA Open

Specialty Anesthesiology

Date 2023 Aug 17

PMID 37588581

Authors

Daniel James Drayton

Michael Ayres

Samuel D Relton

Matthew Sperrin

Marlous Hall

Affiliations

Soon will be listed here.

Abstract

External validation helps to assess whether a given risk prediction model will perform well in a target population. Validation is an important step in maintaining the utility of risk prediction models, as their ability to provide reliable risk estimates will deteriorate over time (calibration drift).

Citing Articles

Predicting Risk of Post-Operative Morbidity and Mortality following Gynaecological Oncology Surgery (PROMEGO): A Global Gynaecological Oncology Surgical Outcomes Collaborative Led Study.

Gaba F, Mahvash Mohammadi S, Krivonosov M, Blyuss O Cancers (Basel). 2024; 16(11).

PMID: 38893143 PMC: 11170986. DOI: 10.3390/cancers16112021.

References

Protopapa K, Simpson J, Smith N, Moonesinghe S . Development and validation of the Surgical Outcome Risk Tool (SORT). Br J Surg. 2014; 101(13):1774-83. PMC: 4240514. DOI: 10.1002/bjs.9638. View

Hippisley-Cox J, Coupland C, Brindle P . Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study. BMJ. 2017; 357:j2099. PMC: 5441081. DOI: 10.1136/bmj.j2099. View

Damen J, Hooft L, Schuit E, Debray T, Collins G, Tzoulaki I . Prediction models for cardiovascular disease risk in the general population: systematic review. BMJ. 2016; 353:i2416. PMC: 4868251. DOI: 10.1136/bmj.i2416. View

Dhiman P, Ma J, Andaur Navarro C, Speich B, Bullock G, Damen J . Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review. BMC Med Res Methodol. 2022; 22(1):101. PMC: 8991704. DOI: 10.1186/s12874-022-01577-x. View

Copeland G, Jones D, Walters M . POSSUM: a scoring system for surgical audit. Br J Surg. 1991; 78(3):355-60. DOI: 10.1002/bjs.1800780327. View

de Hond A, Leeuwenberg A, Hooft L, Kant I, Nijman S, van Os H . Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review. NPJ Digit Med. 2022; 5(1):2. PMC: 8748878. DOI: 10.1038/s41746-021-00549-7. View

Verbakel J, Steyerberg E, Uno H, De Cock B, Wynants L, Collins G . ROC curves for clinical prediction models part 1. ROC plots showed no added value above the AUC when evaluating the performance of clinical prediction models. J Clin Epidemiol. 2020; 126:207-216. DOI: 10.1016/j.jclinepi.2020.01.028. View

Steyerberg E, Vickers A, Cook N, Gerds T, Gonen M, Obuchowski N . Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2009; 21(1):128-38. PMC: 3575184. DOI: 10.1097/EDE.0b013e3181c30fb2. View

Torlot F, Yew C, Reilly J, Phillips M, Weber D, Corcoran T . External validity of four risk scores predicting 30-day mortality after surgery. BJA Open. 2023; 3:100018. PMC: 10430818. DOI: 10.1016/j.bjao.2022.100018. View

10.

Huang J . Representativeness Is Not Representative: Addressing Major Inferential Threats in the UK Biobank and Other Big Data Repositories. Epidemiology. 2020; 32(2):189-193. DOI: 10.1097/EDE.0000000000001317. View

11.

Bilimoria K, Liu Y, Paruch J, Zhou L, Kmiecik T, Ko C . Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013; 217(5):833-42.e1-3. PMC: 3805776. DOI: 10.1016/j.jamcollsurg.2013.07.385. View

12.

Grant S, Collins G, Nashef S . Statistical Primer: developing and validating a risk prediction model. Eur J Cardiothorac Surg. 2018; 54(2):203-208. DOI: 10.1093/ejcts/ezy180. View

13.

Carlisle J . Risk prediction models for major surgery: composing a new tune. Anaesthesia. 2019; 74 Suppl 1:7-12. DOI: 10.1111/anae.14503. View

14.

Davis S, Greevy Jr R, Lasko T, Walsh C, Matheny M . Detection of calibration drift in clinical prediction models to inform model updating. J Biomed Inform. 2020; 112:103611. PMC: 8627243. DOI: 10.1016/j.jbi.2020.103611. View

15.

Collins G, Reitsma J, Altman D, Moons K . Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 2015; 13:1. PMC: 4284921. DOI: 10.1186/s12916-014-0241-z. View

16.

Jenkins D, Martin G, Sperrin M, Riley R, Debray T, Collins G . Continual updating and monitoring of clinical prediction models: time for dynamic prediction systems?. Diagn Progn Res. 2021; 5(1):1. PMC: 7797885. DOI: 10.1186/s41512-020-00090-3. View

17.

Eugene N, Oliver C, Bassett M, Poulton T, Kuryba A, Johnston C . Development and internal validation of a novel risk adjustment model for adult patients undergoing emergency laparotomy surgery: the National Emergency Laparotomy Audit risk model. Br J Anaesth. 2018; 121(4):739-748. DOI: 10.1016/j.bja.2018.06.026. View