CVD22: Explainable Artificial Intelligence Determination of the Relationship of Troponin to D-Dimer, Mortality, and CK-MB in COVID-19 Patients

Overview

Journal Comput Methods Programs Biomed

Specialty Medical Informatics

Date 2023 Mar 25

PMID 36965300

Authors

Kevser Kubra Kirboga

Ecir Ugur Kucuksille

Muhammet Emin Naldan

Mesut Isik

Oktay Gulcu

Emrah Aksakal

Affiliations

Soon will be listed here.

Abstract

Background And Purpose: COVID-19, which emerged in Wuhan (China), is one of the deadliest and fastest-spreading pandemics as of the end of 2019. According to the World Health Organization (WHO), there are more than 100 million infectious cases worldwide. Therefore, research models are crucial for managing the pandemic scenario. However, because the behavior of this epidemic is so complex and difficult to understand, an effective model must not only produce accurate predictive results but must also have a clear explanation that enables human experts to act proactively. For this reason, an innovative study has been planned to diagnose Troponin levels in the COVID-19 process with explainable white box algorithms to reach a clear explanation.

Methods: Using the pandemic data provided by Erzurum Training and Research Hospital (decision number: 2022/13-145), an interpretable explanation of Troponin data was provided in the COVID-19 process with SHApley Additive exPlanations (SHAP) algorithms. Five machine learning (ML) algorithms were developed. Model performances were determined based on training, test accuracies, precision, F1-score, recall, and AUC (Area Under the Curve) values. Feature importance was estimated according to Shapley values by applying the SHApley Additive exPlanations (SHAP) method to the model with high accuracy. The model created with Streamlit v.3.9 was integrated into the interface with the name CVD22.

Results: Among the five-machine learning (ML) models created with pandemic data, the best model was selected with the values of 1.0, 0.83, 0.86, 0.83, 0.80, and 0.91 in train and test accuracy, precision, F1-score, recall, and AUC values, respectively. As a result of feature selection and SHApley Additive exPlanations (SHAP) algorithms applied to the XGBoost model, it was determined that DDimer mean, mortality, CKMB (creatine kinase myocardial band), and Glucose were the features with the highest importance over the model estimation.

Conclusions: Recent advances in new explainable artificial intelligence (XAI) models have successfully made it possible to predict the future using large historical datasets. Therefore, throughout the ongoing pandemic, CVD22 (https://cvd22covid.streamlitapp.com/) can be used as a guide to help authorities or medical professionals make the best decisions quickly.

Citing Articles

Cardiac Parameters Better Predict ICU Admission and Short-Term Mortality in Hospitalized Patients With COVID-19.

Aksakal E, Aydin S, Aydemir S, Sarac I, Aydinyilmaz F, Ozmen M Cureus. 2023; 15(9):e46141.

PMID: 37900381 PMC: 10612987. DOI: 10.7759/cureus.46141.

References

Guan W, Ni Z, Hu Y, Liang W, Ou C, He J . Clinical Characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020; 382(18):1708-1720. PMC: 7092819. DOI: 10.1056/NEJMoa2002032. View

Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z . Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020; 395(10229):1054-1062. PMC: 7270627. DOI: 10.1016/S0140-6736(20)30566-3. View

Huyut M, Huyut Z, Ilkbahar F, Mertoglu C . What is the impact and efficacy of routine immunological, biochemical and hematological biomarkers as predictors of COVID-19 mortality?. Int Immunopharmacol. 2022; 105:108542. PMC: 8761578. DOI: 10.1016/j.intimp.2022.108542. View

Aboughdir M, Kirwin T, Abdul Khader A, Wang B . Prognostic Value of Cardiovascular Biomarkers in COVID-19: A Review. Viruses. 2020; 12(5). PMC: 7290838. DOI: 10.3390/v12050527. View

Zhou K, Sun Y, Li L, Zang Z, Wang J, Li J . Eleven routine clinical features predict COVID-19 severity uncovered by machine learning of longitudinal measurements. Comput Struct Biotechnol J. 2021; 19:3640-3649. PMC: 8225590. DOI: 10.1016/j.csbj.2021.06.022. View

Shi L, Wang Y, Wang Y, Duan G, Yang H . Meta-Analysis of Relation of Creatine kinase-MB to Risk of Mortality in Coronavirus Disease 2019 Patients. Am J Cardiol. 2020; 130:163-165. PMC: 7283078. DOI: 10.1016/j.amjcard.2020.06.004. View

Zoabi Y, Deri-Rozov S, Shomron N . Machine learning-based prediction of COVID-19 diagnosis based on symptoms. NPJ Digit Med. 2021; 4(1):3. PMC: 7782717. DOI: 10.1038/s41746-020-00372-6. View

Carrington A, Manuel D, Fieguth P, Ramsay T, Osmani V, Wernly B . Deep ROC Analysis and AUC as Balanced Average Accuracy, for Improved Classifier Selection, Audit and Explanation. IEEE Trans Pattern Anal Mach Intell. 2022; 45(1):329-341. DOI: 10.1109/TPAMI.2022.3145392. View

Bayat V, Phelps S, Ryono R, Lee C, Parekh H, Mewton J . A Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) Prediction Model From Standard Laboratory Tests. Clin Infect Dis. 2020; 73(9):e2901-e2907. PMC: 7454351. DOI: 10.1093/cid/ciaa1175. View

10.

Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y . Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020; 395(10223):497-506. PMC: 7159299. DOI: 10.1016/S0140-6736(20)30183-5. View

11.

Madjid M, Safavi-Naeini P, Solomon S, Vardeny O . Potential Effects of Coronaviruses on the Cardiovascular System: A Review. JAMA Cardiol. 2020; 5(7):831-840. DOI: 10.1001/jamacardio.2020.1286. View

12.

Cai W, Liu T, Xue X, Luo G, Wang X, Shen Y . CT Quantification and Machine-learning Models for Assessment of Disease Severity and Prognosis of COVID-19 Patients. Acad Radiol. 2020; 27(12):1665-1678. PMC: 7505599. DOI: 10.1016/j.acra.2020.09.004. View

13.

Altmann A, Tolosi L, Sander O, Lengauer T . Permutation importance: a corrected feature importance measure. Bioinformatics. 2010; 26(10):1340-7. DOI: 10.1093/bioinformatics/btq134. View

14.

Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J . Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA. 2020; 323(11):1061-1069. PMC: 7042881. DOI: 10.1001/jama.2020.1585. View

15.

Guo T, Fan Y, Chen M, Wu X, Zhang L, He T . Cardiovascular Implications of Fatal Outcomes of Patients With Coronavirus Disease 2019 (COVID-19). JAMA Cardiol. 2020; 5(7):811-818. PMC: 7101506. DOI: 10.1001/jamacardio.2020.1017. View

16.

Welsh T, Kukes G, Sandweiss L . Differences of creatine kinase MB and cardiac troponin I concentrations in normal and diseased human myocardium. Ann Clin Lab Sci. 2002; 32(1):44-9. View

17.

Pham Q, Nguyen D, Huynh-The T, Hwang W, Pathirana P . Artificial Intelligence (AI) and Big Data for Coronavirus (COVID-19) Pandemic: A Survey on the State-of-the-Arts. IEEE Access. 2021; 8:130820-130839. PMC: 8545324. DOI: 10.1109/ACCESS.2020.3009328. View

18.

Banoei M, Dinparastisaleh R, Zadeh A, Mirsaeidi M . Machine-learning-based COVID-19 mortality prediction model and identification of patients at low and high risk of dying. Crit Care. 2021; 25(1):328. PMC: 8424411. DOI: 10.1186/s13054-021-03749-5. View

19.

Rostami M, Oussalah M . A novel explainable COVID-19 diagnosis method by integration of feature selection with random forest. Inform Med Unlocked. 2022; 30:100941. PMC: 8985417. DOI: 10.1016/j.imu.2022.100941. View

20.

Ghassemi M, Oakden-Rayner L, Beam A . The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021; 3(11):e745-e750. DOI: 10.1016/S2589-7500(21)00208-9. View