Article: Editorial: Challenges for the usability of AR and VR for clinical neurosurgical procedures

There are a number of challenges that must be faced when trying to develop AR and VR-based Neurosurgical simulators, Surgical Navigation Platforms, and "Smart OR" systems. Trying to simulate an operating room environment and surgical tasks in Augmented and Virtual Reality is a challenge many are attempting to solve, in order to train surgeons or help them operate. What are some of the needs of the surgeon, and what are the challenges encountered (human computer interface, perception, workflow, etc). We discuss these tradeoffs and conclude with critical remarks.

Citing Articles

AR-AI assisted ophthalmic nursing: Preliminary usability study in clinical settings.

Huang C, Sheng Y, Lian H, Zhang W, Lin H, Huang X Digit Health. 2024; 10:20552076241269470.

PMID: 39257872 PMC: 11384517. DOI: 10.1177/20552076241269470.

Clinical trainee performance on task-based AR/VR-guided surgical simulation is correlated with their 3D image spatial reasoning scores.

Eagleson R, Kikinov D, Bilbie L, De Ribaupierre S Healthc Technol Lett. 2024; 11(2-3):117-125.

PMID: 38638489 PMC: 11022220. DOI: 10.1049/htl2.12066.

Feasibility of Augmented Reality for Pediatric Giant Supratentorial Tumors: A Report of Three Cases.

Wu Y, Esguerra J, Liang S, Low S Cureus. 2024; 16(3):e56750.

PMID: 38523873 PMC: 10960069. DOI: 10.7759/cureus.56750.

Bone biopsies guided by augmented reality: a pilot study.

Albano D, Messina C, Gitto S, Chianca V, Sconfienza L Eur Radiol Exp. 2023; 7(1):40.

PMID: 37468652 PMC: 10356701. DOI: 10.1186/s41747-023-00353-w.

Thermal Ablation of Liver Tumors Guided by Augmented Reality: An Initial Clinical Experience.

Solbiati M, Ierace T, Muglia R, Pedicini V, Iezzi R, Passera K Cancers (Basel). 2022; 14(5).

PMID: 35267620 PMC: 8909771. DOI: 10.3390/cancers14051312.

References

1.

King A, Edwards P, Maurer Jr C, de Cunha D, Hawkes D, Hill D . A system for microscope-assisted guided interventions. Stereotact Funct Neurosurg. 2000; 72(2-4):107-11. DOI: 10.1159/000029708. View

2.

Lemole Jr G, Banerjee P, Luciano C, Neckrysh S, Charbel F . Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery. 2007; 61(1):142-8. DOI: 10.1227/01.neu.0000279734.22931.21. View

3.

Low D, Lee C, Dip L, Ng W, Ang B, Ng I . Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Br J Neurosurg. 2010; 24(1):69-74. DOI: 10.3109/02688690903506093. View

4.

Delorme S, Laroche D, DiRaddo R, Del Maestro R . NeuroTouch: a physics-based virtual simulator for cranial microneurosurgery training. Neurosurgery. 2012; 71(1 Suppl Operative):32-42. DOI: 10.1227/NEU.0b013e318249c744. View

5.

Inoue D, Cho B, Mori M, Kikkawa Y, Amano T, Nakamizo A . Preliminary study on the clinical application of augmented reality neuronavigation. J Neurol Surg A Cent Eur Neurosurg. 2013; 74(2):71-6. DOI: 10.1055/s-0032-1333415. View

6.

Deng W, Li F, Wang M, Song Z . Easy-to-use augmented reality neuronavigation using a wireless tablet PC. Stereotact Funct Neurosurg. 2013; 92(1):17-24. DOI: 10.1159/000354816. View

7.

Cabrilo I, Bijlenga P, Schaller K . Augmented reality in the surgery of cerebral aneurysms: a technical report. Neurosurgery. 2014; 10 Suppl 2:252-60. DOI: 10.1227/NEU.0000000000000328. View

8.

Kramers M, Armstrong R, Bakhshmand S, Fenster A, De Ribaupierre S, Eagleson R . Evaluation of a mobile augmented reality application for image guidance of neurosurgical interventions. Stud Health Technol Inform. 2014; 196:204-8. View

9.

Abhari K, Baxter J, Chen E, Khan A, Peters T, De Ribaupierre S . Training for planning tumour resection: augmented reality and human factors. IEEE Trans Biomed Eng. 2014; 62(6):1466-77. DOI: 10.1109/TBME.2014.2385874. View

10.

Kockro R, Killeen T, Ayyad A, Glaser M, Stadie A, Reisch R . Aneurysm Surgery with Preoperative Three-Dimensional Planning in a Virtual Reality Environment: Technique and Outcome Analysis. World Neurosurg. 2016; 96:489-499. DOI: 10.1016/j.wneu.2016.08.124. View

11.

Wright T, De Ribaupierre S, Eagleson R . Design and evaluation of an augmented reality simulator using leap motion. Healthc Technol Lett. 2017; 4(5):210-215. PMC: 5683193. DOI: 10.1049/htl.2017.0070. View

Editorial: Challenges for the Usability of AR and VR for Clinical Neurosurgical Procedures