Mixed Reality Applications in Upper Extremity Surgery: the Future is Now

Overview

Journal EFORT Open Rev

Specialty Orthopedics

Date 2024 Nov 8

PMID 39513697

Authors

Daniel B Calem

Przemyslaw Lubiatowski

Scott Trenhaile

Bruno Gobbato

Ivan Wong

Jawaher Alkhateeb

John Erickson

Affiliations

Soon will be listed here.

Abstract

Mixed reality refers to the integration of virtual reality into the real-world environment. This digital content can be interacted with in real time. The emergence of mixed reality technology has been made possible by the introduction of head-mounted displays, which are being utilized across multiple surgical specialties. In upper extremity surgery, mixed reality has widespread applications in trauma, corrective surgery, arthroplasty, arthroscopy, and oncology. Preoperatively, mixed reality allows for complex 3D planning. Intraoperatively, surgeons can access this 3D data in a sterile environment. While in its infant stages, mixed reality is likely to become a powerful tool for intraoperative guidance and navigation. Mixed reality can change the paradigm of communication, as it allows the sharing of visual data from the surgeon's perspective, enabling remote assistance and participation.

References

Shiode R, Oka K, Shigi A, Miyamura S, Tanaka H, Mae T . Arthroscopic Debridement of Elbow Osteoarthritis Using CT-Based Computer-Aided Navigation Systems Is Accurate. Arthrosc Sports Med Rehabil. 2022; 3(6):e1687-e1696. PMC: 8689228. DOI: 10.1016/j.asmr.2021.07.025. View

Wu J, Wang M, Liu K, Hu M, Lee P . Real-time advanced spinal surgery via visible patient model and augmented reality system. Comput Methods Programs Biomed. 2014; 113(3):869-81. DOI: 10.1016/j.cmpb.2013.12.021. View

Rahman R, Wood M, Qian L, Price C, Johnson A, Osgood G . Head-Mounted Display Use in Surgery: A Systematic Review. Surg Innov. 2019; 27(1):88-100. DOI: 10.1177/1553350619871787. View

Berritto D, Pinto A, Russo A, Urraro F, Laporta A, Belfiore M . Scapular fractures: a common diagnostic pitfall. Acta Biomed. 2018; 89(1-S):102-110. PMC: 6179069. DOI: 10.23750/abm.v89i1-S.7014. View

Trebacz P, Frymus J, Barteczko A, Pawlik M, Kurkowska A, Czopowicz M . Accuracy of Instrument Portal Placement Using a Custom-Made 3D-Printed Aiming Device versus Free Hand Technique in Canine Elbow Arthroscopy. Animals (Basel). 2023; 13(23). PMC: 10705517. DOI: 10.3390/ani13233592. View

Hiranaka T, Fujishiro T, Hida Y, Shibata Y, Tsubosaka M, Nakanishi Y . Augmented reality: The use of the PicoLinker smart glasses improves wire insertion under fluoroscopy. World J Orthop. 2018; 8(12):891-894. PMC: 5745431. DOI: 10.5312/wjo.v8.i12.891. View

Verhey J, Haglin J, Verhey E, Hartigan D . Virtual, augmented, and mixed reality applications in orthopedic surgery. Int J Med Robot. 2019; 16(2):e2067. DOI: 10.1002/rcs.2067. View

Heifner J, Chambers L, Halpern A, Mercer D . The Internal Joint Stabilizer of the Elbow: A Systematic Review of the Clinical and Biomechanical Evidence. J Hand Surg Glob Online. 2024; 6(1):62-67. PMC: 10837289. DOI: 10.1016/j.jhsg.2023.09.004. View

Hallet J, Soler L, Diana M, Mutter D, Baumert T, Habersetzer F . Trans-thoracic minimally invasive liver resection guided by augmented reality. J Am Coll Surg. 2015; 220(5):e55-60. DOI: 10.1016/j.jamcollsurg.2014.12.053. View

10.

You C, Zhou Y, Han J . Loss of correction in cubitus varus deformity after osteotomy. Medicine (Baltimore). 2021; 100(49):e27848. PMC: 8663885. DOI: 10.1097/MD.0000000000027848. View

11.

Sanchez-Sotelo J, Berhouet J, Chaoui J, Freehill M, Collin P, Warner J . Validation of mixed-reality surgical navigation for glenoid axis pin placement in shoulder arthroplasty using a cadaveric model. J Shoulder Elbow Surg. 2023; 33(5):1177-1184. DOI: 10.1016/j.jse.2023.09.027. View

12.

Daher M, Ghanimeh J, Otayek J, Ghoul A, Bizdikian A, El Abiad R . Augmented reality and shoulder replacement: a state-of-the-art review article. JSES Rev Rep Tech. 2023; 3(3):274-278. PMC: 10426657. DOI: 10.1016/j.xrrt.2023.01.008. View

13.

Meola A, Cutolo F, Carbone M, Cagnazzo F, Ferrari M, Ferrari V . Augmented reality in neurosurgery: a systematic review. Neurosurg Rev. 2016; 40(4):537-548. PMC: 6155988. DOI: 10.1007/s10143-016-0732-9. View

14.

Scalise J, Codsi M, Bryan J, Brems J, Iannotti J . The influence of three-dimensional computed tomography images of the shoulder in preoperative planning for total shoulder arthroplasty. J Bone Joint Surg Am. 2008; 90(11):2438-45. DOI: 10.2106/JBJS.G.01341. View

15.

Navab N, Heining S, Traub J . Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging. 2010; 29(7):1412-23. DOI: 10.1109/TMI.2009.2021947. View

16.

Hoffmann M, Hartel M, Schroeder M, Reinsch O, Spiro A, Ruecker A . Electromagnetic navigation provides high accuracy for transcoracoid-transclavicular drilling. Knee Surg Sports Traumatol Arthrosc. 2013; 22(9):2237-42. DOI: 10.1007/s00167-013-2607-8. View

17.

Gregory T, Gregory J, Sledge J, Allard R, Mir O . Surgery guided by mixed reality: presentation of a proof of concept. Acta Orthop. 2018; 89(5):480-483. PMC: 6202760. DOI: 10.1080/17453674.2018.1506974. View

18.

Condino S, Turini G, Parchi P, Viglialoro R, Piolanti N, Gesi M . How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens. J Healthc Eng. 2018; 2018:5435097. PMC: 6236521. DOI: 10.1155/2018/5435097. View

19.

Iannotti J, Baker J, Rodriguez E, Brems J, Ricchetti E, Mesiha M . Three-dimensional preoperative planning software and a novel information transfer technology improve glenoid component positioning. J Bone Joint Surg Am. 2014; 96(9):e71. DOI: 10.2106/JBJS.L.01346. View

20.

Abe Y, Sato S, Kato K, Hyakumachi T, Yanagibashi Y, Ito M . A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. J Neurosurg Spine. 2013; 19(4):492-501. DOI: 10.3171/2013.7.SPINE12917. View