Performance of Automated ASPECTS Software and Value As a Computer-Aided Detection Tool

Overview

Journal AJNR Am J Neuroradiol

Specialty Neurology

Date 2023 Jul 27

PMID 37500286

Authors

J Lambert

J Demeestere

B Dewachter

L Cockmartin

A Wouters

R Symons

L Boomgaert

L Vandewalle

L Scheldeman

P Demaerel

R Lemmens

Affiliations

Soon will be listed here.

Abstract

Background And Purpose: ASPECTS quantifies early ischemic changes in anterior circulation stroke on NCCT but has interrater variability. We examined the agreement of conventional and automated ASPECTS and studied the value of computer-aided detection.

Materials And Methods: We retrospectively collected imaging data from consecutive patients with acute ischemic stroke with large-vessel occlusion undergoing thrombectomy. Five raters scored conventional ASPECTS on baseline NCCTs, which were also processed by RAPID software. Conventional and automated ASPECTS were compared with a consensus criterion standard. We determined the agreement over the full ASPECTS range as well as dichotomized, reflecting thrombectomy eligibility according to the guidelines (ASPECTS 0-5 versus 6-10). Raters subsequently scored ASPECTS on the same NCCTs with assistance of the automated ASPECTS outputs, and agreement was obtained.

Results: For the total of 175 cases, agreement among raters individually and the criterion standard varied from fair to good (weighted κ = between 0.38 and 0.76) and was moderate (weighted κ = 0.59) for the automated ASPECTS. The agreement of all raters individually versus the criterion standard improved with software assistance, as did the interrater agreement (overall Fleiss κ = 0.15-0.23; < .001 and .39 to .55; = .01 for the dichotomized ASPECTS).

Conclusions: Automated ASPECTS had agreement with the criterion standard similar to that of conventional ASPECTS. However, including automated ASPECTS during the evaluation of NCCT in acute stroke improved the agreement with the criterion standard and improved interrater agreement, which could, therefore, result in more uniform scoring in clinical practice.

References

Sundaram V, Goldstein J, Wheelwright D, Aggarwal A, Pawha P, Doshi A . Automated ASPECTS in Acute Ischemic Stroke: A Comparative Analysis with CT Perfusion. AJNR Am J Neuroradiol. 2019; 40(12):2033-2038. PMC: 6975365. DOI: 10.3174/ajnr.A6303. View

McHugh M . Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012; 22(3):276-82. PMC: 3900052. View

Nagel S, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P . e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke. 2016; 12(6):615-622. DOI: 10.1177/1747493016681020. View

Wilson A, Dey S, Evans J, Najm M, Qiu W, Menon B . Minds treating brains: understanding the interpretation of non-contrast CT ASPECTS in acute ischemic stroke. Expert Rev Cardiovasc Ther. 2017; 16(2):143-153. DOI: 10.1080/14779072.2018.1421069. View

Herweh C, Ringleb P, Rauch G, Gerry S, Behrens L, Mohlenbruch M . Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke. 2016; 11(4):438-45. DOI: 10.1177/1747493016632244. View

Hoelter P, Muehlen I, Goelitz P, Beuscher V, Schwab S, Doerfler A . Automated ASPECT scoring in acute ischemic stroke: comparison of three software tools. Neuroradiology. 2020; 62(10):1231-1238. DOI: 10.1007/s00234-020-02439-3. View

Pfaff J, Herweh C, Schieber S, Schonenberger S, Bosel J, Ringleb P . e-ASPECTS Correlates with and Is Predictive of Outcome after Mechanical Thrombectomy. AJNR Am J Neuroradiol. 2017; 38(8):1594-1599. PMC: 7960437. DOI: 10.3174/ajnr.A5236. View

Albers G, Wald M, Mlynash M, Endres J, Bammer R, Straka M . Automated Calculation of Alberta Stroke Program Early CT Score: Validation in Patients With Large Hemispheric Infarct. Stroke. 2019; 50(11):3277-3279. DOI: 10.1161/STROKEAHA.119.026430. View

Loffler M, Sollmann N, Monch S, Friedrich B, Zimmer C, Baum T . Improved Reliability of Automated ASPECTS Evaluation Using Iterative Model Reconstruction from Head CT Scans. J Neuroimaging. 2021; 31(2):341-347. DOI: 10.1111/jon.12810. View

10.

Huo X, Ma G, Tong X, Zhang X, Pan Y, Nguyen T . Trial of Endovascular Therapy for Acute Ischemic Stroke with Large Infarct. N Engl J Med. 2023; 388(14):1272-1283. DOI: 10.1056/NEJMoa2213379. View

11.

Sarraj A, Hassan A, Abraham M, Ortega-Gutierrez S, Kasner S, Hussain M . Trial of Endovascular Thrombectomy for Large Ischemic Strokes. N Engl J Med. 2023; 388(14):1259-1271. DOI: 10.1056/NEJMoa2214403. View

12.

Neuhaus A, Seyedsaadat S, Mihal D, Benson J, Mark I, Kallmes D . Region-specific agreement in ASPECTS estimation between neuroradiologists and e-ASPECTS software. J Neurointerv Surg. 2019; 12(7):720-723. DOI: 10.1136/neurintsurg-2019-015442. View

13.

Powers W, Rabinstein A, Ackerson T, Adeoye O, Bambakidis N, Becker K . Guidelines for the Early Management of Patients With Acute Ischemic Stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American.... Stroke. 2019; 50(12):e344-e418. DOI: 10.1161/STR.0000000000000211. View

14.

Olive-Gadea M, Martins N, Boned S, Carvajal J, Moreno M, Muchada M . Baseline ASPECTS and e-ASPECTS Correlation with Infarct Volume and Functional Outcome in Patients Undergoing Mechanical Thrombectomy. J Neuroimaging. 2018; 29(2):198-202. DOI: 10.1111/jon.12564. View

15.

Chen Z, Shi Z, Lu F, Li L, Li M, Wang S . Validation of two automated ASPECTS software on non-contrast computed tomography scans of patients with acute ischemic stroke. Front Neurol. 2023; 14:1170955. PMC: 10116051. DOI: 10.3389/fneur.2023.1170955. View

16.

Gupta A, Schaefer P, Chaudhry Z, Leslie-Mazwi T, Chandra R, Gonzalez R . Interobserver reliability of baseline noncontrast CT Alberta Stroke Program Early CT Score for intra-arterial stroke treatment selection. AJNR Am J Neuroradiol. 2012; 33(6):1046-9. PMC: 8013224. DOI: 10.3174/ajnr.A2942. View

17.

Goebel J, Stenzel E, Guberina N, Wanke I, Koehrmann M, Kleinschnitz C . Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Neuroradiology. 2018; 60(12):1267-1272. DOI: 10.1007/s00234-018-2098-x. View

18.

Mair G, White P, Bath P, Muir K, Salman R, Martin C . External Validation of e-ASPECTS Software for Interpreting Brain CT in Stroke. Ann Neurol. 2022; 92(6):943-957. PMC: 9826303. DOI: 10.1002/ana.26495. View

19.

Barber P, Demchuk A, Zhang J, Buchan A . Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group. Alberta Stroke Programme Early CT Score. Lancet. 2000; 355(9216):1670-4. DOI: 10.1016/s0140-6736(00)02237-6. View

20.

Nicholson P, Hilditch C, Neuhaus A, Seyedsaadat S, Benson J, Mark I . Per-region interobserver agreement of Alberta Stroke Program Early CT Scores (ASPECTS). J Neurointerv Surg. 2020; 12(11):1069-1071. DOI: 10.1136/neurintsurg-2019-015473. View