Assessment of Interrater Reliability and Accuracy of Cerebral Aneurysm Morphometry Using 3D Virtual Reality, 2D Digital Subtraction Angiography, and 3D Reconstruction: A Randomized Comparative Study

Overview

Journal Brain Sci

Publisher MDPI

Date 2024 Oct 25

PMID 39451982

Authors

Attill Saemann

Daniel De Wilde

Jonathan Rychen

Michel Roethlisberger

Marek Zelechowski

Balazs Faludi

Philippe Claude Cattin

Marios-Nikos Psychogios

Jehuda Soleman

Raphael Guzman

Affiliations

Soon will be listed here.

Abstract

Background/objectives: Detailed morphometric analysis of an aneurysm and the related vascular bifurcation are critical factors when determining rupture risk and planning treatment for unruptured intracranial aneurysms (UIAs). The standard visualization of digital subtraction angiography (DSA) and its 3D reconstruction on a 2D monitor provide precise measurements but are subject to variability based on the rater. Visualization using virtual (VR) and augmented reality platforms can overcome those limitations. It is, however, unclear whether accurate measurements of the aneurysm and adjacent arterial branches can be obtained on VR models. This study aimed to assess interrater reliability and compare measurements between 3D VR, standard 2D DSA, and 3D DSA reconstructions, evaluating the reliability and accuracy of 3D VR as a measurement tool.

Methods: A pool of five neurosurgeons performed three individual analyses on each of the ten UIA cases, measuring them in completely immersed 3D VR and the standard on-screen format (2D DSA and 3D reconstruction). This resulted in three independent measurements per modality for each case. Interrater reliability of measurements and morphology characterization, comparative differences, measurement duration, and VR user experience were assessed.

Results: Interrater reliability for 3D VR measurements was significantly higher than for 3D DSA measurements (3D VR mean intraclass correlation coefficient [ICC]: 0.69 ± 0.22 vs. 3D DSA mean ICC: 0.36 ± 0.37, = 0.042). No significant difference was observed between 3D VR and 2D DSA (3D VR mean ICC: 0.69 ± 0.22 vs. 2D DSA mean ICC: 0.43 ± 0.31, = 0.12). A linear mixed-effects model showed no effect of 3D VR and 3D DSA (95% CI = -0.26-0.28, = 0.96) or 3D VR and 2D DSA (95% CI = -0.02-0.53, = 0.066) on absolute measurements of the aneurysm in the anteroposterior, mediolateral, and craniocaudal dimensions.

Conclusions: 3D VR technology allows for reproducible, accurate, and reliable measurements comparable to measurements performed on a 2D screen. It may also potentially improve precision for measurements of non-planar aneurysm dimensions.

References

Briganti F, Tortora M, Loiudice G, Tarantino M, Guida A, Buono G . Utility of virtual stenting in treatment of cerebral aneurysms by flow diverter devices. Radiol Med. 2023; 128(4):480-491. DOI: 10.1007/s11547-023-01620-x. View

Greving J, Wermer M, Brown Jr R, Morita A, Juvela S, Yonekura M . Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol. 2013; 13(1):59-66. DOI: 10.1016/S1474-4422(13)70263-1. View

Greuter L, De Rosa A, Cattin P, Croci D, Soleman J, Guzman R . Randomized study comparing 3D virtual reality and conventional 2D on-screen teaching of cerebrovascular anatomy. Neurosurg Focus. 2021; 51(2):E18. DOI: 10.3171/2021.5.FOCUS21212. View

van Rooij W, Sprengers M, de Gast A, Peluso J, Sluzewski M . 3D rotational angiography: the new gold standard in the detection of additional intracranial aneurysms. AJNR Am J Neuroradiol. 2008; 29(5):976-9. PMC: 8128578. DOI: 10.3174/ajnr.A0964. View

Etminan N, Brown Jr R, Beseoglu K, Juvela S, Raymond J, Morita A . The unruptured intracranial aneurysm treatment score: a multidisciplinary consensus. Neurology. 2015; 85(10):881-9. PMC: 4560059. DOI: 10.1212/WNL.0000000000001891. View

Ujiie H, TAMANO Y, Sasaki K, Hori T . Is the aspect ratio a reliable index for predicting the rupture of a saccular aneurysm?. Neurosurgery. 2001; 48(3):495-502; discussion 502-3. DOI: 10.1097/00006123-200103000-00007. View

Rutledge C, Jonzzon S, Winkler E, Raper D, Lawton M, Abla A . Small Aneurysms with Low PHASES Scores Account for Most Subarachnoid Hemorrhage Cases. World Neurosurg. 2020; 139:e580-e584. DOI: 10.1016/j.wneu.2020.04.074. View

Ikawa F, Morita A, Tominari S, Nakayama T, Shiokawa Y, Date I . Rupture risk of small unruptured cerebral aneurysms. J Neurosurg. 2019; 132(1):69-78. DOI: 10.3171/2018.9.JNS181736. View

Steineke T, Barbery D . Microsurgical clipping of middle cerebral artery aneurysms: preoperative planning using virtual reality to reduce procedure time. Neurosurg Focus. 2021; 51(2):E12. DOI: 10.3171/2021.5.FOCUS21238. View

10.

Kockro R, Killeen T, Ayyad A, Glaser M, Stadie A, Reisch R . Aneurysm Surgery with Preoperative Three-Dimensional Planning in a Virtual Reality Environment: Technique and Outcome Analysis. World Neurosurg. 2016; 96:489-499. DOI: 10.1016/j.wneu.2016.08.124. View

11.

Maloca P, de Carvalho J, Heeren T, Hasler P, Mushtaq F, Mon-Williams M . High-Performance Virtual Reality Volume Rendering of Original Optical Coherence Tomography Point-Cloud Data Enhanced With Real-Time Ray Casting. Transl Vis Sci Technol. 2018; 7(4):2. PMC: 6038772. DOI: 10.1167/tvst.7.4.2. View

12.

Kiyosue H, Tanoue S, Okahara M, Hori Y, Nakamura T, Nagatomi H . Anatomic features predictive of complete aneurysm occlusion can be determined with three-dimensional digital subtraction angiography. AJNR Am J Neuroradiol. 2002; 23(7):1206-13. PMC: 8185727. View

13.

Backes D, Vergouwen M, Velthuis B, van der Schaaf I, Bor A, Algra A . Difference in aneurysm characteristics between ruptured and unruptured aneurysms in patients with multiple intracranial aneurysms. Stroke. 2014; 45(5):1299-303. DOI: 10.1161/STROKEAHA.113.004421. View

14.

Sakamoto S, Kiura Y, Shibukawa M, Ohba S, Arita K, Kurisu K . Subtracted 3D CT angiography for evaluation of internal carotid artery aneurysms: comparison with conventional digital subtraction angiography. AJNR Am J Neuroradiol. 2006; 27(6):1332-7. PMC: 8133950. View

15.

Malhotra A, Wu X, Forman H, Grossetta Nardini H, Matouk C, Gandhi D . Growth and Rupture Risk of Small Unruptured Intracranial Aneurysms: A Systematic Review. Ann Intern Med. 2017; 167(1):26-33. DOI: 10.7326/M17-0246. View

16.

Dhar S, Tremmel M, Mocco J, Kim M, Yamamoto J, Siddiqui A . Morphology parameters for intracranial aneurysm rupture risk assessment. Neurosurgery. 2008; 63(2):185-96. PMC: 2570753. DOI: 10.1227/01.NEU.0000316847.64140.81. View

17.

Saemann A, Schmid S, Licci M, Zelechowski M, Faludi B, Cattin P . Enhancing educational experience through establishing a VR database in craniosynostosis: report from a single institute and systematic literature review. Front Surg. 2024; 11:1440042. PMC: 11408475. DOI: 10.3389/fsurg.2024.1440042. View

18.

Rychen J, Saemann A, Gehweiler J, Roethlisberger M, Soleman J, Hutter G . The sylvian keyhole approach for surgical clipping of middle cerebral artery aneurysms: Technical nuance to the minipterional craniotomy. Front Surg. 2023; 9:1078735. PMC: 9810108. DOI: 10.3389/fsurg.2022.1078735. View

19.

Timmins K, Kuijf H, Vergouwen M, Otten M, Ruigrok Y, Velthuis B . Reliability and Agreement of 2D and 3D Measurements on MRAs for Growth Assessment of Unruptured Intracranial Aneurysms. AJNR Am J Neuroradiol. 2021; 42(9):1598-1603. PMC: 8423061. DOI: 10.3174/ajnr.A7186. View

20.

Ujiie H, Tachibana H, Hiramatsu O, Hazel A, Matsumoto T, Ogasawara Y . Effects of size and shape (aspect ratio) on the hemodynamics of saccular aneurysms: a possible index for surgical treatment of intracranial aneurysms. Neurosurgery. 1999; 45(1):119-29; discussion 129-30. DOI: 10.1097/00006123-199907000-00028. View