HTC Vive MeVisLab Integration Via OpenVR for Medical Applications

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2017 Mar 22

PMID 28323840

Citations 24

Authors

Jan Egger

Markus Gall

Jurgen Wallner

Pedro Boechat

Alexander Hann

Xing Li

Xiaojun Chen

Dieter Schmalstieg

Affiliations

Soon will be listed here.

Abstract

Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection.

Citing Articles

Assessing the impact of immersive virtual reality technology on the psychological recovery of patients with Parkinson's disease depression: study protocol of a randomized controlled trial.

Chen X, Chen L, Chen X, Ye Q, Cai G, Zeng Y Trials. 2024; 25(1):715.

PMID: 39456018 PMC: 11515453. DOI: 10.1186/s13063-024-08552-5.

Is the Apple Vision Pro the Ultimate Display? A First Perspective and Survey on Entering the Wonderland of Precision Medicine.

Egger J, Gsaxner C, Luijten G, Chen J, Chen X, Bian J JMIR Serious Games. 2024; 12:e52785.

PMID: 39292499 PMC: 11447423. DOI: 10.2196/52785.

Type B Aortic Dissection CTA Collection with True and False Lumen Expert Annotations for the Development of AI-based Algorithms.

Mayer C, Pepe A, Hossain S, Karner B, Arnreiter M, Kleesiek J Sci Data. 2024; 11(1):596.

PMID: 38844767 PMC: 11156948. DOI: 10.1038/s41597-024-03284-2.

Individual Influence of Trochlear Dysplasia on Patellofemoral Kinematics after Isolated MPFL Reconstruction.

Frodl A, Lange T, Siegel M, Meine H, Taghizadeh E, Schmal H J Pers Med. 2022; 12(12).

PMID: 36556269 PMC: 9786691. DOI: 10.3390/jpm12122049.

Studierfenster: an Open Science Cloud-Based Medical Imaging Analysis Platform.

Egger J, Wild D, Weber M, Bedoya C, Karner F, Prutsch A J Digit Imaging. 2022; 35(2):340-355.

PMID: 35064372 PMC: 8782222. DOI: 10.1007/s10278-021-00574-8.

References

Egger J, Tokuda J, Chauvin L, Freisleben B, Nimsky C, Kapur T . Integration of the OpenIGTLink network protocol for image-guided therapy with the medical platform MeVisLab. Int J Med Robot. 2012; 8(3):282-90. PMC: 3405168. DOI: 10.1002/rcs.1415. View

Tian J, Xue J, Dai Y, Chen J, Zheng J . A novel software platform for medical image processing and analyzing. IEEE Trans Inf Technol Biomed. 2008; 12(6):800-12. DOI: 10.1109/TITB.2008.926395. View

Egger J, Busse H, Brandmaier P, Seider D, Gawlitza M, Strocka S . Interactive Volumetry Of Liver Ablation Zones. Sci Rep. 2015; 5:15373. PMC: 4612735. DOI: 10.1038/srep15373. View

Schwarzenberg R, Freisleben B, Nimsky C, Egger J . Cube-cut: vertebral body segmentation in MRI-data through cubic-shaped divergences. PLoS One. 2014; 9(4):e93389. PMC: 3976281. DOI: 10.1371/journal.pone.0093389. View

Reitinger B, Bornik A, Beichel R, Schmalstieg D . Liver surgery planning using virtual reality. IEEE Comput Graph Appl. 2006; 26(6):36-47. DOI: 10.1109/mcg.2006.131. View

Gall M, Li X, Chen X, Schmalstieg D, Egger J . Computer-aided planning and reconstruction of cranial 3D implants. Annu Int Conf IEEE Eng Med Biol Soc. 2017; 2016:1179-1183. DOI: 10.1109/EMBC.2016.7590915. View

Egger J, Kapur T, Nimsky C, Kikinis R . Pituitary adenoma volumetry with 3D Slicer. PLoS One. 2012; 7(12):e51788. PMC: 3519899. DOI: 10.1371/journal.pone.0051788. View

Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X . Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform. 2015; 55:124-31. DOI: 10.1016/j.jbi.2015.04.003. View

Egger J . PCG-cut: graph driven segmentation of the prostate central gland. PLoS One. 2013; 8(10):e76645. PMC: 3795743. DOI: 10.1371/journal.pone.0076645. View

10.

Egger J, Kapur T, Dukatz T, Kolodziej M, Zukic D, Freisleben B . Square-cut: a segmentation algorithm on the basis of a rectangle shape. PLoS One. 2012; 7(2):e31064. PMC: 3283589. DOI: 10.1371/journal.pone.0031064. View

11.

Ai Z, Evenhouse R, Leigh J, Charbel F, Rasmussen M . Cranial implant design using augmented reality immersive system. Stud Health Technol Inform. 2007; 125:7-12. View

12.

Cha Y, Dou M, Chabra R, Menozzi F, State A, Wallen E . Immersive Learning Experiences for Surgical Procedures. Stud Health Technol Inform. 2016; 220:55-62. View

13.

Gor M, McCloy R, Stone R, Smith A . Virtual reality laparoscopic simulator for assessment in gynaecology. BJOG. 2003; 110(2):181-7. View

14.

Egger J, Kapur T, Fedorov A, Pieper S, Miller J, Veeraraghavan H . GBM volumetry using the 3D Slicer medical image computing platform. Sci Rep. 2013; 3:1364. PMC: 3586703. DOI: 10.1038/srep01364. View

15.

Newbutt N, Sung C, Kuo H, Leahy M, Lin C, Tong B . Brief Report: A Pilot Study of the Use of a Virtual Reality Headset in Autism Populations. J Autism Dev Disord. 2016; 46(9):3166-76. DOI: 10.1007/s10803-016-2830-5. View

16.

Alcantarilla P, Bartoli A, Chadebecq F, Tilmant C, Lepilliez V . Enhanced imaging colonoscopy facilitates dense motion-based 3D reconstruction. Annu Int Conf IEEE Eng Med Biol Soc. 2013; 2013:7346-9. DOI: 10.1109/EMBC.2013.6611255. View

17.

McCloy R, Stone R . Science, medicine, and the future. Virtual reality in surgery. BMJ. 2001; 323(7318):912-5. PMC: 1121442. DOI: 10.1136/bmj.323.7318.912. View

18.

Renapurkar R, Setser R, ODonnell T, Egger J, Lieber M, Desai M . Aortic volume as an indicator of disease progression in patients with untreated infrarenal abdominal aneurysm. Eur J Radiol. 2011; 81(2):e87-93. DOI: 10.1016/j.ejrad.2011.01.077. View

19.

Kim J, Chung C, Nakamura S, Palmisano S, Khuu S . The Oculus Rift: a cost-effective tool for studying visual-vestibular interactions in self-motion perception. Front Psychol. 2015; 6:248. PMC: 4358060. DOI: 10.3389/fpsyg.2015.00248. View

20.

Klemm M, Kirchner T, Grohl J, Cheray D, Nolden M, Seitel A . MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions. Int J Comput Assist Radiol Surg. 2016; 12(3):351-361. DOI: 10.1007/s11548-016-1488-y. View