Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

Overview

Journal Sensors (Basel)

Publisher MDPI

Specialty Biotechnology

Date 2022 Oct 27

PMID 36298059

Authors

Arrigo Palumbo

Affiliations

Soon will be listed here.

Abstract

In the world reference context, although virtual reality, augmented reality and mixed reality have been emerging methodologies for several years, only today technological and scientific advances have made them suitable to revolutionize clinical care and medical contexts through the provision of enhanced functionalities and improved health services. This systematic review provides the state-of-the-art applications of the Microsoft HoloLens 2 in a medical and healthcare context. Focusing on the potential that this technology has in providing digitally supported clinical care, also but not only in relation to the COVID-19 pandemic, studies that proved the applicability and feasibility of HoloLens 2 in a medical and healthcare scenario were considered. The review presents a thorough examination of the different studies conducted since 2019, focusing on HoloLens 2 medical sub-field applications, device functionalities provided to users, software/platform/framework used, as well as the study validation. The results provided in this paper could highlight the potential and limitations of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as telemedicine, remote control and motor rehabilitation.

Citing Articles

The use of three-dimensional printing and virtual reality technologies in orthopaedics-with a focus on orthopaedic trauma.

Policicchio T, Konar K, Brameier D, Sadoghi P, Suneja N, Stenquist D J Clin Orthop Trauma. 2025; 63:102930.

PMID: 40012847 PMC: 11850734. DOI: 10.1016/j.jcot.2025.102930.

Impact on Body Composition and Physical Fitness of an Exercise Program Based on Immersive Virtual Reality: A Case Report.

Godoy-Cumillaf A, Fuentes-Merino P, Giakoni-Ramirez F, Maldonado-Sandoval M, Bruneau-Chavez J, Merellano-Navarro E J Funct Morphol Kinesiol. 2025; 10(1).

PMID: 39982296 PMC: 11843897. DOI: 10.3390/jfmk10010056.

Augmented Reality for extremity hemorrhage training: a usability study.

Tharun K, Drogo A, Recchiuto C, Ricci S Front Digit Health. 2025; 6():1479544.

PMID: 39834839 PMC: 11743514. DOI: 10.3389/fdgth.2024.1479544.

Toward structured abdominal examination training using augmented reality.

Schwenderling L, Hanke L, Holst U, Huettl F, Joeres F, Huber T Int J Comput Assist Radiol Surg. 2025; .

PMID: 39755835 DOI: 10.1007/s11548-024-03311-y.

Artificial Intelligence in Medical Metaverse: Applications, Challenges, and Future Prospects.

Yang J, Chen B, Li R, Huang B, Zhao M, Liu P Curr Med Sci. 2024; 44(6):1113-1122.

PMID: 39673002 DOI: 10.1007/s11596-024-2960-5.

References

Koyachi M, Sugahara K, Odaka K, Matsunaga S, Abe S, Sugimoto M . Accuracy of Le Fort I osteotomy with combined computer-aided design/computer-aided manufacturing technology and mixed reality. Int J Oral Maxillofac Surg. 2020; 50(6):782-790. DOI: 10.1016/j.ijom.2020.09.026. View

Weech S, Kenny S, Barnett-Cowan M . Presence and Cybersickness in Virtual Reality Are Negatively Related: A Review. Front Psychol. 2019; 10:158. PMC: 6369189. DOI: 10.3389/fpsyg.2019.00158. View

Hu H, Feng X, Shao Z, Xie M, Xu S, Wu X . Application and Prospect of Mixed Reality Technology in Medical Field. Curr Med Sci. 2019; 39(1):1-6. DOI: 10.1007/s11596-019-1992-8. View

Kitagawa M, Sugimoto M, Haruta H, Umezawa A, Kurokawa Y . Intraoperative holography navigation using a mixed-reality wearable computer during laparoscopic cholecystectomy. Surgery. 2021; 171(4):1006-1013. DOI: 10.1016/j.surg.2021.10.004. View

Hanna M, Ahmed I, Nine J, Prajapati S, Pantanowitz L . Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology. Arch Pathol Lab Med. 2018; 142(5):638-644. DOI: 10.5858/arpa.2017-0189-OA. View

Garcia-Sevilla M, Moreta-Martinez R, Garcia-Mato D, Pose-Diez-de-la-Lastra A, Perez-Mananes R, Calvo-Haro J . Augmented Reality as a Tool to Guide PSI Placement in Pelvic Tumor Resections. Sensors (Basel). 2021; 21(23). PMC: 8659846. DOI: 10.3390/s21237824. View

Thabit A, Benmahdjoub M, van Veelen M, Niessen W, Wolvius E, van Walsum T . Augmented reality navigation for minimally invasive craniosynostosis surgery: a phantom study. Int J Comput Assist Radiol Surg. 2022; 17(8):1453-1460. PMC: 9307543. DOI: 10.1007/s11548-022-02634-y. View

Levy J, Kong E, Johnson N, Khetarpal A, Tomlinson J, Martin G . The mixed reality medical ward round with the MS HoloLens 2: Innovation in reducing COVID-19 transmission and PPE usage. Future Healthc J. 2021; 8(1):e127-e130. PMC: 8004303. DOI: 10.7861/fhj.2020-0146. View

Felix B, Kalatar S, Moatz B, Hofstetter C, Karsy M, Parr R . Augmented Reality Spine Surgery Navigation: Increasing Pedicle Screw Insertion Accuracy for Both Open and Minimally Invasive Spine Surgeries. Spine (Phila Pa 1976). 2022; 47(12):865-872. DOI: 10.1097/BRS.0000000000004338. View

10.

Farshad M, Spirig J, Suter D, Hoch A, Burkhard M, Liebmann F . Operator independent reliability of direct augmented reality navigated pedicle screw placement and rod bending. N Am Spine Soc J. 2022; 8:100084. PMC: 8819958. DOI: 10.1016/j.xnsj.2021.100084. View

11.

Velazco-Garcia J, Navkar N, Balakrishnan S, Younes G, Abi-Nahed J, Al-Rumaihi K . Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies. Int J Med Robot. 2021; 17(5):e2290. DOI: 10.1002/rcs.2290. View

12.

Park B, Hunt S, Nadolski G, Gade T . Augmented reality improves procedural efficiency and reduces radiation dose for CT-guided lesion targeting: a phantom study using HoloLens 2. Sci Rep. 2020; 10(1):18620. PMC: 7596500. DOI: 10.1038/s41598-020-75676-4. View

13.

Wolf J, Wolfer V, Halbe M, Maisano F, Lohmeyer Q, Meboldt M . Comparing the effectiveness of augmented reality-based and conventional instructions during single ECMO cannulation training. Int J Comput Assist Radiol Surg. 2021; 16(7):1171-1180. PMC: 8260416. DOI: 10.1007/s11548-021-02408-y. View

14.

Mitani S, Sato E, Kawaguchi N, Sawada S, Sakamoto K, Kitani T . Case-specific three-dimensional hologram with a mixed reality technique for tumor resection in otolaryngology. Laryngoscope Investig Otolaryngol. 2021; 6(3):432-437. PMC: 8223462. DOI: 10.1002/lio2.581. View

15.

Mill T, Parikh S, Allen A, Dart G, Lee D, Richardson C . Live streaming ward rounds using wearable technology to teach medical students: a pilot study. BMJ Simul Technol Enhanc Learn. 2022; 7(6):494-500. PMC: 8154297. DOI: 10.1136/bmjstel-2021-000864. View

16.

Matsuhashi K, Kanamoto T, Kurokawa A . Thermal Model and Countermeasures for Future Smart Glasses. Sensors (Basel). 2020; 20(5). PMC: 7085683. DOI: 10.3390/s20051446. View

17.

Rafi D, Stackhouse A, Walls R, Dani M, Cowell A, Hughes E . A new reality: Bedside geriatric teaching in an age of remote learning. Future Healthc J. 2021; 8(3):e714-e716. PMC: 8651335. DOI: 10.7861/fhj.2021-0108. View

18.

Dolega-Dolegowski D, Proniewska K, Dolega-Dolegowska M, Pregowska A, Hajto-Bryk J, Trojak M . Application of holography and augmented reality based technology to visualize the internal structure of the dental root - a proof of concept. Head Face Med. 2022; 18(1):12. PMC: 8981712. DOI: 10.1186/s13005-022-00307-4. View

19.

Doughty M, Ghugre N . Head-Mounted Display-Based Augmented Reality for Image-Guided Media Delivery to the Heart: A Preliminary Investigation of Perceptual Accuracy. J Imaging. 2022; 8(2). PMC: 8878166. DOI: 10.3390/jimaging8020033. View

20.

Morimoto T, Hirata H, Ueno M, Fukumori N, Sakai T, Sugimoto M . Digital Transformation Will Change Medical Education and Rehabilitation in Spine Surgery. Medicina (Kaunas). 2022; 58(4). PMC: 9030988. DOI: 10.3390/medicina58040508. View