Concepts for Augmented Reality Visualisation to Support Needle Guidance Inside the MRI

Overview

Journal Healthc Technol Lett

Publisher Wiley

Specialty Biomedical Engineering

Date 2018 Nov 23

PMID 30464849

Citations 4

Authors

Andre Mewes

Florian Heinrich

Bennet Hensen

Frank Wacker

Kai Lawonn

Christian Hansen

Affiliations

Soon will be listed here.

Abstract

During MRI-guided interventions, navigation support is often separated from the operating field on displays, which impedes the interpretation of positions and orientations of instruments inside the patient's body as well as hand-eye coordination. To overcome these issues projector-based augmented reality can be used to support needle guidance inside the MRI bore directly in the operating field. The authors present two visualisation concepts for needle navigation aids which were compared in an accuracy and usability study with eight participants, four of whom were experienced radiologists. The results show that both concepts are equally accurate ( and ), useful and easy to use, with clear visual feedback about the state and success of the needle puncture. For easier clinical applicability, a dynamic projection on moving surfaces and organ movement tracking are needed. For now, tests with patients with respiratory arrest are feasible.

Citing Articles

Magnetic resonance - guided treatment of low-flow vascular malformations and the technologies to potentiate adoption.

Bailey C, Herrera D, Neumeister N, Weiss C Front Med (Lausanne). 2024; 11:1319046.

PMID: 38420359 PMC: 10899448. DOI: 10.3389/fmed.2024.1319046.

Augmented reality technology in image-guided therapy: State-of-the-art review.

Zhao Z, Poyhonen J, Chen Cai X, Hooper F, Ma Y, Hu Y Proc Inst Mech Eng H. 2021; 235(12):1386-1398.

PMID: 34304631 PMC: 8573682. DOI: 10.1177/09544119211034357.

Real-Time Magnetic Resonance Imaging.

Nayak K, Lim Y, Campbell-Washburn A, Steeden J J Magn Reson Imaging. 2020; 55(1):81-99.

PMID: 33295674 PMC: 8435094. DOI: 10.1002/jmri.27411.

HoloInjection: augmented reality support for CT-guided spinal needle injections.

Heinrich F, Schwenderling L, Becker M, Skalej M, Hansen C Healthc Technol Lett. 2020; 6(6):165-171.

PMID: 32038851 PMC: 6942927. DOI: 10.1049/htl.2019.0062.

References

Hoffmann R, Thomas C, Rempp H, Schmidt D, Pereira P, Claussen C . Performing MR-guided biopsies in clinical routine: factors that influence accuracy and procedure time. Eur Radiol. 2011; 22(3):663-71. DOI: 10.1007/s00330-011-2297-x. View

Meyer B, Brost A, Kraitchman D, Gilson W, Strobel N, Hornegger J . Percutaneous punctures with MR imaging guidance: comparison between MR imaging-enhanced fluoroscopic guidance and real-time MR Imaging guidance. Radiology. 2013; 266(3):912-9. DOI: 10.1148/radiol.12120117. View

Fritz J, U-Thainual P, Ungi T, Flammang A, Cho N, Fichtinger G . Augmented reality visualization with image overlay for MRI-guided intervention: accuracy for lumbar spinal procedures with a 1.5-T MRI system. AJR Am J Roentgenol. 2012; 198(3):W266-73. DOI: 10.2214/AJR.11.6918. View

Gavaghan K, Oliveira-Santos T, Peterhans M, Reyes M, Kim H, Anderegg S . Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies. Int J Comput Assist Radiol Surg. 2011; 7(4):547-56. DOI: 10.1007/s11548-011-0660-7. View

Schullian P, Widmann G, Lang T, Knoflach M, Bale R . Accuracy and diagnostic yield of CT-guided stereotactic liver biopsy of primary and secondary liver tumors. Comput Aided Surg. 2011; 16(4):181-7. DOI: 10.3109/10929088.2011.578367. View

Weiss C, Nour S, Lewin J . MR-guided biopsy: a review of current techniques and applications. J Magn Reson Imaging. 2008; 27(2):311-25. DOI: 10.1002/jmri.21270. View

Oliveira-Santos T, Klaeser B, Weitzel T, Krause T, Nolte L, Peterhans M . A navigation system for percutaneous needle interventions based on PET/CT images: design, workflow and error analysis of soft tissue and bone punctures. Comput Aided Surg. 2011; 16(5):203-19. DOI: 10.3109/10929088.2011.597566. View

Krempien R, Hoppe H, Kahrs L, Daeuber S, Schorr O, Eggers G . Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. Int J Radiat Oncol Biol Phys. 2008; 70(3):944-52. DOI: 10.1016/j.ijrobp.2007.10.048. View

Seitel A, Bellemann N, Hafezi M, Franz A, Servatius M, Saffari A . Towards markerless navigation for percutaneous needle insertions. Int J Comput Assist Radiol Surg. 2015; 11(1):107-17. DOI: 10.1007/s11548-015-1156-7. View

10.

Black D, Hettig J, Luz M, Hansen C, Kikinis R, Hahn H . Auditory feedback to support image-guided medical needle placement. Int J Comput Assist Radiol Surg. 2017; 12(9):1655-1663. PMC: 5561528. DOI: 10.1007/s11548-017-1537-1. View

11.

Manzey D, Rottger S, Bahner-Heyne J, Schulze-Kissing D, Dietz A, Meixensberger J . Image-guided navigation: the surgeon's perspective on performance consequences and human factors issues. Int J Med Robot. 2009; 5(3):297-308. DOI: 10.1002/rcs.261. View

12.

Wacker F, Vogt S, Khamene A, Jesberger J, Nour S, Elgort D . An augmented reality system for MR image-guided needle biopsy: initial results in a swine model. Radiology. 2006; 238(2):497-504. DOI: 10.1148/radiol.2382041441. View

13.

Rothgang E, Gilson W, Wacker F, Hornegger J, Lorenz C, Weiss C . Rapid freehand MR-guided percutaneous needle interventions: an image-based approach to improve workflow and feasibility. J Magn Reson Imaging. 2013; 37(5):1202-12. DOI: 10.1002/jmri.23894. View

14.

Mewes A, Heinrich F, Kagebein U, Hensen B, Wacker F, Hansen C . Projector-based augmented reality system for interventional visualization inside MRI scanners. Int J Med Robot. 2018; 15(1):e1950. DOI: 10.1002/rcs.1950. View

15.

Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer G, Mathieu H . Image overlay guidance for needle insertion in CT scanner. IEEE Trans Biomed Eng. 2005; 52(8):1415-24. DOI: 10.1109/TBME.2005.851493. View

16.

Busse H, Garnov N, Thormer G, Zajonz D, Grunder W, Kahn T . Flexible add-on solution for MR image-guided interventions in a closed-bore scanner environment. Magn Reson Med. 2010; 64(3):922-8. DOI: 10.1002/mrm.22464. View

17.

Moche M, Zajonz D, Kahn T, Busse H . MRI-guided procedures in various regions of the body using a robotic assistance system in a closed-bore scanner: preliminary clinical experience and limitations. J Magn Reson Imaging. 2010; 31(4):964-74. DOI: 10.1002/jmri.21990. View

18.

Kersten-Oertel M, Chen S, Collins D . An evaluation of depth enhancing perceptual cues for vascular volume visualization in neurosurgery. IEEE Trans Vis Comput Graph. 2014; 20(3):391-403. DOI: 10.1109/TVCG.2013.240. View

19.

Fischbach F, Bunke J, Thormann M, Gaffke G, Jungnickel K, Smink J . MR-guided freehand biopsy of liver lesions with fast continuous imaging using a 1.0-T open MRI scanner: experience in 50 patients. Cardiovasc Intervent Radiol. 2010; 34(1):188-92. DOI: 10.1007/s00270-010-9836-8. View

20.

Rempp H, Loh H, Hoffmann R, Rothgang E, Pan L, Claussen C . Liver lesion conspicuity during real-time MR-guided radiofrequency applicator placement using spoiled gradient echo and balanced steady-state free precession imaging. J Magn Reson Imaging. 2014; 40(2):432-9. DOI: 10.1002/jmri.24371. View