Charlson Comorbidity Index Derived from Chart Review or Administrative Data: Agreement and Prediction of Mortality in Intensive Care Patients

Overview

Journal Clin Epidemiol

Publisher Dove Medical Press

Specialty Public Health

Date 2017 Jun 28

PMID 28652813

Citations 66

Authors

Knut Stavem

Henrik Hoel

Stein Arve Skjaker

Rolf Haagensen

Affiliations

Soon will be listed here.

Abstract

Purpose: This study compared the Charlson comorbidity index (CCI) information derived from chart review and administrative systems to assess the completeness and agreement between scores, evaluate the capacity to predict 30-day and 1-year mortality in intensive care unit (ICU) patients, and compare the predictive capacity with that of the Simplified Acute Physiology Score (SAPS) II model.

Patients And Methods: Using data from 959 patients admitted to a general ICU in a Norwegian university hospital from 2007 to 2009, we compared the CCI score derived from chart review and administrative systems. Agreement was assessed using % agreement, kappa, and weighted kappa. The capacity to predict 30-day and 1-year mortality was assessed using logistic regression, model discrimination with the -statistic, and calibration with a goodness-of-fit statistic.

Results: The CCI was complete (n=959) when calculated from chart review, but less complete from administrative data (n=839). Agreement was good, with a weighted kappa of 0.667 (95% confidence interval: 0.596-0.714). The -statistics for categorized CCI scores from charts and administrative data were similar in the model that included age, sex, and type of admission: 0.755 and 0.743 for 30-day mortality, respectively, and 0.783 and 0.775, respectively, for 1-year mortality. Goodness-of-fit statistics supported the model fit.

Conclusion: The CCI scores from chart review and administrative data showed good agreement and predicted 30-day and 1-year mortality in ICU patients. CCI combined with age, sex, and type of admission predicted mortality almost as well as the physiology-based SAPS II.

Citing Articles

Frequency, financial impact, and factors associated with cost outliers in intensive care units: a cohort study in Belgium.

Bruyneel A, den Bulcke J, Leclercq P, Pirson M Crit Care Sci. 2025; 37:e20250207.

PMID: 39879435 PMC: 11805458. DOI: 10.62675/2965-2774.20250207.

Prevalence of cancer-related fatigue, associated factors and adult cancer patients' experiences at Hawassa University Comprehensive Specialized Hospital in Ethiopia: a mixed methods study.

Asefa T, Bitew G, Tezera H, Tesfaye W Front Oncol. 2024; 14:1480246.

PMID: 39555447 PMC: 11563971. DOI: 10.3389/fonc.2024.1480246.

Discharge Opioid Prescription and Consumption Following Surgery: The POPCORN Observational Study.

Mohktari K, Wong A, Nguyen M, Giard A, Ly B, Wazzan D Can J Hosp Pharm. 2024; 77(3):e3574.

PMID: 39262623 PMC: 11361310. DOI: 10.4212/cjhp.3574.

Effect of radiotherapy on long-term quality of life in recurrence-free rectal cancer survivors (LaTE study): nationwide inverse probability of treatment-weighted registry-based cohort study and survey.

Malik Y, Saltyte Benth J, Hamre H, Faerden A, Schultz J BJS Open. 2024; 8(5).

PMID: 39240223 PMC: 11378401. DOI: 10.1093/bjsopen/zrae091.

Effect of Cost-Exemption Policy on Treatment Interruption in Patients With Newly Diagnosed Pulmonary Tuberculosis in South Korea.

Lee S, Lee J, Ji H, Lee J, Park S, Han C Int J Health Policy Manag. 2024; 13:8262.

PMID: 39099483 PMC: 11365073. DOI: 10.34172/ijhpm.8262.

References

Humphries K, Rankin J, Carere R, Buller C, Kiely F, Spinelli J . Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review?. J Clin Epidemiol. 2000; 53(4):343-9. DOI: 10.1016/s0895-4356(99)00188-2. View

Johnston J, Wagner D, Timmons S, Welsh D, Tsevat J, Render M . Impact of different measures of comorbid disease on predicted mortality of intensive care unit patients. Med Care. 2002; 40(10):929-40. DOI: 10.1097/00005650-200210000-00010. View

Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali W . New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004; 57(12):1288-94. DOI: 10.1016/j.jclinepi.2004.03.012. View

Quan H, Li B, Couris C, Fushimi K, Graham P, Hider P . Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011; 173(6):676-82. DOI: 10.1093/aje/kwq433. View

Hoel H, Skjaker S, Haagensen R, Stavem K . Decisions to withhold or withdraw life-sustaining treatment in a Norwegian intensive care unit. Acta Anaesthesiol Scand. 2014; 58(3):329-36. DOI: 10.1111/aas.12246. View

Austin S, Wong Y, Uzzo R, Beck J, Egleston B . Why Summary Comorbidity Measures Such As the Charlson Comorbidity Index and Elixhauser Score Work. Med Care. 2013; 53(9):e65-72. PMC: 3818341. DOI: 10.1097/MLR.0b013e318297429c. View

Southern D, Quan H, Ghali W . Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data. Med Care. 2004; 42(4):355-60. DOI: 10.1097/01.mlr.0000118861.56848.ee. View

de Groot V, Beckerman H, Lankhorst G, Bouter L . How to measure comorbidity. a critical review of available methods. J Clin Epidemiol. 2003; 56(3):221-9. DOI: 10.1016/s0895-4356(02)00585-1. View

Charlson M, Pompei P, Ales K, MacKenzie C . A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987; 40(5):373-83. DOI: 10.1016/0021-9681(87)90171-8. View

10.

Knaus W, Wagner D, Draper E . APACHE III study design: analytic plan for evaluation of severity and outcome in intensive care unit patients. Implications. Crit Care Med. 1989; 17(12 Pt 2):S219-21. View

11.

Lee D, Donovan L, Austin P, Gong Y, Liu P, Rouleau J . Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005; 43(2):182-8. DOI: 10.1097/00005650-200502000-00012. View

12.

Quan H, Li B, Saunders L, Parsons G, Nilsson C, Alibhai A . Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Serv Res. 2008; 43(4):1424-41. PMC: 2517283. DOI: 10.1111/j.1475-6773.2007.00822.x. View

13.

Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J . Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005; 43(11):1130-9. DOI: 10.1097/01.mlr.0000182534.19832.83. View

14.

Williams T, Ho K, Dobb G, Finn J, Knuiman M, Webb S . Changes in case-mix and outcomes of critically ill patients in an Australian tertiary intensive care unit. Anaesth Intensive Care. 2010; 38(4):703-9. DOI: 10.1177/0310057X1003800414. View

15.

Elixhauser A, Steiner C, Harris D, Coffey R . Comorbidity measures for use with administrative data. Med Care. 1998; 36(1):8-27. DOI: 10.1097/00005650-199801000-00004. View

16.

Luthi J, Troillet N, Eisenring M, Sax H, Burnand B, Quan H . Administrative data outperformed single-day chart review for comorbidity measure. Int J Qual Health Care. 2007; 19(4):225-31. DOI: 10.1093/intqhc/mzm017. View

17.

Ghali W, Hall R, Rosen A, Ash A, Moskowitz M . Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. J Clin Epidemiol. 1996; 49(3):273-8. DOI: 10.1016/0895-4356(95)00564-1. View

18.

Stukenborg G, Wagner D, Connors Jr A . Comparison of the performance of two comorbidity measures, with and without information from prior hospitalizations. Med Care. 2001; 39(7):727-39. DOI: 10.1097/00005650-200107000-00009. View

19.

Kieszak S, Flanders W, Kosinski A, Shipp C, KARP H . A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data. J Clin Epidemiol. 1999; 52(2):137-42. DOI: 10.1016/s0895-4356(98)00154-1. View

20.

Christensen S, Johansen M, Christiansen C, Jensen R, Lemeshow S . Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care. Clin Epidemiol. 2011; 3:203-11. PMC: 3130905. DOI: 10.2147/CLEP.S20247. View