Accuracy of Emergency Department Triage Using the Emergency Severity Index and Independent Predictors of Under-triage and Over-triage in Brazil: a Retrospective Cohort Analysis

Overview

Journal Int J Emerg Med

Publisher Biomed Central

Specialty Emergency Medicine

Date 2018 Jan 17

PMID 29335793

Citations 41

Authors

Jeremiah S Hinson

Diego A Martinez

Paulo S K Schmitz

Matthew Toerper

Danieli Radu

James Scheulen

Sarah A Stewart de Ramirez

Scott Levin

Affiliations

Soon will be listed here.

Abstract

Background: Emergency department (ED) triage is performed to prioritize care for patients with critical and time-sensitive illness. Triage errors create opportunity for increased morbidity and mortality. Here, we sought to measure the frequency of under- and over-triage of patients by nurses using the Emergency Severity Index (ESI) in Brazil and to identify factors independently associated with each.

Methods: This was a single-center retrospective cohort study. The accuracy of initial ESI score assignment was determined by comparison with a score entered at the close of each ED encounter by treating physicians with full knowledge of actual resource utilization, disposition, and acute outcomes. Chi-square analysis was used to validate this surrogate gold standard, via comparison of associations with disposition and clinical outcomes. Independent predictors of under- and over-triage were identified by multivariate logistic regression.

Results: Initial ESI-determined triage score was classified as inaccurate for 16,426 of 96,071 patient encounters. Under-triage was associated with a significantly higher rate of admission and critical outcome, while over-triage was associated with a lower rate of both. A number of factors identifiable at time of presentation including advanced age, bradycardia, tachycardia, hypoxia, hyperthermia, and several specific chief complaints (i.e., neurologic complaints, chest pain, shortness of breath) were identified as independent predictors of under-triage, while other chief complaints (i.e., hypertension and allergic complaints) were independent predictors of over-triage.

Conclusions: Despite rigorous and ongoing training of ESI users, a large number of patients in this cohort were under- or over-triaged. Advanced age, vital sign derangements, and specific chief complaints-all subject to limited guidance by the ESI algorithm-were particularly under-appreciated.

Citing Articles

Effect of triage training on nurses with Emergency severity index and Australian triage scale: Α quasi-experimental study.

Pontisidis G, Bellali T, Galanis P, Polyzos N AIMS Public Health. 2025; 11(4):1049-1070.

PMID: 39802566 PMC: 11717548. DOI: 10.3934/publichealth.2024054.

Using machine learning and natural language processing in triage for prediction of clinical disposition in the emergency department.

Chang Y, Lin Y, Huang F, Chen D, Chung Y, Chen W BMC Emerg Med. 2024; 24(1):237.

PMID: 39695961 PMC: 11657801. DOI: 10.1186/s12873-024-01152-1.

Integrating structured and unstructured data for predicting emergency severity: an association and predictive study using transformer-based natural language processing models.

Zhang X, Wang Y, Jiang Y, Pacella C, Zhang W BMC Med Inform Decis Mak. 2024; 24(1):372.

PMID: 39633370 PMC: 11619330. DOI: 10.1186/s12911-024-02793-9.

Improving triage performance in emergency departments using machine learning and natural language processing: a systematic review.

Porto B BMC Emerg Med. 2024; 24(1):219.

PMID: 39558255 PMC: 11575054. DOI: 10.1186/s12873-024-01135-2.

Factors influencing the classification accuracy of triage nurses in emergency department: analysis of triage nurses' characteristics.

Seo Y, Lee K, Jang K BMC Nurs. 2024; 23(1):764.

PMID: 39420318 PMC: 11488205. DOI: 10.1186/s12912-024-02334-9.

References

Eitel D, Travers D, Rosenau A, Gilboy N, Wuerz R . The emergency severity index triage algorithm version 2 is reliable and valid. Acad Emerg Med. 2003; 10(10):1070-80. DOI: 10.1111/j.1553-2712.2003.tb00577.x. View

Wuerz R, Milne L, EITEL D, Travers D, Gilboy N . Reliability and validity of a new five-level triage instrument. Acad Emerg Med. 2000; 7(3):236-42. DOI: 10.1111/j.1553-2712.2000.tb01066.x. View

Dugas A, Kirsch T, Toerper M, Korley F, Yenokyan G, France D . An Electronic Emergency Triage System to Improve Patient Distribution by Critical Outcomes. J Emerg Med. 2016; 50(6):910-8. DOI: 10.1016/j.jemermed.2016.02.026. View

Platts-Mills T, Travers D, Biese K, McCall B, Kizer S, LaMantia M . Accuracy of the Emergency Severity Index triage instrument for identifying elder emergency department patients receiving an immediate life-saving intervention. Acad Emerg Med. 2010; 17(3):238-43. DOI: 10.1111/j.1553-2712.2010.00670.x. View

Pines J, Hilton J, Weber E, Alkemade A, Al Shabanah H, Anderson P . International perspectives on emergency department crowding. Acad Emerg Med. 2011; 18(12):1358-70. DOI: 10.1111/j.1553-2712.2011.01235.x. View

Haas B, Gomez D, Zagorski B, Stukel T, Rubenfeld G, Nathens A . Survival of the fittest: the hidden cost of undertriage of major trauma. J Am Coll Surg. 2010; 211(6):804-11. DOI: 10.1016/j.jamcollsurg.2010.08.014. View

Kulstad E, Kelley K . Overcrowding is associated with delays in percutaneous coronary intervention for acute myocardial infarction. Int J Emerg Med. 2010; 2(3):149-54. PMC: 2760695. DOI: 10.1007/s12245-009-0107-x. View

Sills M, Fairclough D, Ranade D, Kahn M . Emergency department crowding is associated with decreased quality of care for children with acute asthma. Ann Emerg Med. 2010; 57(3):191-200.e1-7. DOI: 10.1016/j.annemergmed.2010.08.027. View

DeVos E, Jacobson L . Approach to Adult Patients with Acute Dyspnea. Emerg Med Clin North Am. 2015; 34(1):129-49. PMC: 7126145. DOI: 10.1016/j.emc.2015.08.008. View

10.

McGillicuddy D, OConnell F, Shapiro N, Calder S, Mottley L, Roberts J . Emergency department abnormal vital sign "triggers" program improves time to therapy. Acad Emerg Med. 2011; 18(5):483-7. DOI: 10.1111/j.1553-2712.2011.01056.x. View

11.

Mills A, Shofer F, Chen E, Hollander J, Pines J . The association between emergency department crowding and analgesia administration in acute abdominal pain patients. Acad Emerg Med. 2009; 16(7):603-8. DOI: 10.1111/j.1553-2712.2009.00441.x. View

12.

van der Wulp I, Rullmann H, Leenen L, van Stel H . Associations of the Emergency Severity Index triage categories with patients' vital signs at triage: a prospective observational study. Emerg Med J. 2010; 28(12):1032-5. DOI: 10.1136/emj.2010.096172. View

13.

Schull M, Vermeulen M, Slaughter G, Morrison L, Daly P . Emergency department crowding and thrombolysis delays in acute myocardial infarction. Ann Emerg Med. 2004; 44(6):577-85. DOI: 10.1016/j.annemergmed.2004.05.004. View

14.

McHugh M, Tanabe P, McClelland M, Khare R . More patients are triaged using the Emergency Severity Index than any other triage acuity system in the United States. Acad Emerg Med. 2012; 19(1):106-9. DOI: 10.1111/j.1553-2712.2011.01240.x. View

15.

Woo K, Schneider J . High-risk chief complaints I: chest pain--the big three. Emerg Med Clin North Am. 2009; 27(4):685-712, x. DOI: 10.1016/j.emc.2009.07.007. View

16.

Iserson K, Moskop J . Triage in medicine, part I: Concept, history, and types. Ann Emerg Med. 2006; 49(3):275-81. DOI: 10.1016/j.annemergmed.2006.05.019. View

17.

Stead L, Jain A, Decker W . Emergency department over-crowding: a global perspective. Int J Emerg Med. 2010; 2(3):133-4. PMC: 2760705. DOI: 10.1007/s12245-009-0131-x. View

18.

Seiger N, van Veen M, Steyerberg E, Ruige M, van Meurs A, Moll H . Undertriage in the Manchester triage system: an assessment of severity and options for improvement. Arch Dis Child. 2011; 96(7):653-7. DOI: 10.1136/adc.2010.206797. View

19.

Hitchcock M, Gillespie B, Crilly J, Chaboyer W . Triage: an investigation of the process and potential vulnerabilities. J Adv Nurs. 2013; 70(7):1532-41. DOI: 10.1111/jan.12304. View

20.

Barfod C, Lauritzen M, Danker J, Soletormos G, Forberg J, Berlac P . Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department - a prospective cohort study. Scand J Trauma Resusc Emerg Med. 2012; 20:28. PMC: 3384463. DOI: 10.1186/1757-7241-20-28. View