Augmented Endoscopic Images Overlaying Shape Changes in Bone Cutting Procedures

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2016 Sep 2

PMID 27584732

Citations 2

Authors

Megumi Nakao

Shota Endo

Shinichi Nakao

Munehito Yoshida

Tetsuya Matsuda

Affiliations

Soon will be listed here.

Abstract

In microendoscopic discectomy for spinal disorders, bone cutting procedures are performed in tight spaces while observing a small portion of the target structures. Although optical tracking systems are able to measure the tip of the surgical tool during surgery, the poor shape information available during surgery makes accurate cutting difficult, even if preoperative computed tomography and magnetic resonance images are used for reference. Shape estimation and visualization of the target structures are essential for accurate cutting. However, time-varying shape changes during cutting procedures are still challenging issues for intraoperative navigation. This paper introduces a concept of endoscopic image augmentation that overlays shape changes to support bone cutting procedures. This framework handles the history of the location of the measured drill tip as a volume label and visualizes the remains to be cut overlaid on the endoscopic image in real time. A cutting experiment was performed with volunteers, and the feasibility of this concept was examined using a clinical navigation system. The efficacy of the cutting aid was evaluated with respect to the shape similarity, total moved distance of a cutting tool, and required cutting time. The results of the experiments showed that cutting performance was significantly improved by the proposed framework.

Citing Articles

Review of Enhanced Handheld Surgical Drills.

Usevitch D, Bronheim R, Cartagena-Reyes M, Ortiz-Babilonia C, Margalit A, Jain A Crit Rev Biomed Eng. 2023; 51(6):29-50.

PMID: 37824333 PMC: 10874117. DOI: 10.1615/CritRevBiomedEng.2023049106.

A novel noise filtered and occlusion removal: navigational accuracy in augmented reality-based constructive jaw surgery.

Basnet B, Alsadoon A, Withana C, Deva A, Paul M Oral Maxillofac Surg. 2018; 22(4):385-401.

PMID: 30206745 DOI: 10.1007/s10006-018-0719-5.

References

Luan S, Wang T, Li W, Liu Z, Jiang L, Hu L . 3D navigation and monitoring for spinal milling operation based on registration between multiplanar fluoroscopy and CT images. Comput Methods Programs Biomed. 2012; 108(1):151-7. DOI: 10.1016/j.cmpb.2012.02.007. View

Haouchine N, Cotin S, Peterlik I, Dequidt J, Sanz Lopez M, Kerrien E . Impact of Soft Tissue Heterogeneity on Augmented Reality for Liver Surgery. IEEE Trans Vis Comput Graph. 2015; 21(5):584-97. DOI: 10.1109/TVCG.2014.2377772. View

Park P . Three-dimensional computed tomography-based spinal navigation in minimally invasive lateral lumbar interbody fusion: feasibility, technique, and initial results. Neurosurgery. 2015; 11 Suppl 2:259-67. DOI: 10.1227/NEU.0000000000000726. View

Bichlmeier C, Heining S, Feuerstein M, Navab N . The virtual mirror: a new interaction paradigm for augmented reality environments. IEEE Trans Med Imaging. 2009; 28(9):1498-510. DOI: 10.1109/TMI.2009.2018622. View

Imanishi K, Nakao M, Kioka M, Mori M, Yoshida M, Takahashi T . Interactive bone drilling using a 2D pointing device to support Microendoscopic Discectomy planning. Int J Comput Assist Radiol Surg. 2010; 5(5):461-9. DOI: 10.1007/s11548-010-0413-z. View

Liao H, Inomata T, Sakuma I, Dohi T . 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng. 2010; 57(6):1476-86. DOI: 10.1109/TBME.2010.2040278. View

Wang X, Zhang Q, Han Q, Yang R, Carswell M, Seales B . Endoscopic video texture mapping on pre-built 3-D anatomical objects without camera tracking. IEEE Trans Med Imaging. 2009; 29(6):1213-23. DOI: 10.1109/TMI.2009.2028341. View

Tjardes T, Shafizadeh S, Rixen D, Paffrath T, Bouillon B, Steinhausen E . Image-guided spine surgery: state of the art and future directions. Eur Spine J. 2009; 19(1):25-45. PMC: 2899744. DOI: 10.1007/s00586-009-1091-9. View

Helm P, Teichman R, Hartmann S, Simon D . Spinal Navigation and Imaging: History, Trends, and Future. IEEE Trans Med Imaging. 2015; 34(8):1738-46. DOI: 10.1109/TMI.2015.2391200. View

10.

Edwards P, King A, Maurer Jr C, de Cunha D, Hawkes D, Hill D . Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Trans Med Imaging. 2001; 19(11):1082-93. DOI: 10.1109/42.896784. View

11.

Morris D, Sewell C, Barbagli F, Salisbury K, Blevins N, Girod S . Visuohaptic simulation of bone surgery for training and evaluation. IEEE Comput Graph Appl. 2006; 26(6):48-57. DOI: 10.1109/mcg.2006.140. View

12.

Smith N, Masters J, Jensen C, Khan A, Sprowson A . Systematic review of microendoscopic discectomy for lumbar disc herniation. Eur Spine J. 2013; 22(11):2458-65. PMC: 3886516. DOI: 10.1007/s00586-013-2848-8. View

13.

Cartiaux O, Paul L, Francq B, Banse X, Docquier P . Improved accuracy with 3D planning and patient-specific instruments during simulated pelvic bone tumor surgery. Ann Biomed Eng. 2013; 42(1):205-13. DOI: 10.1007/s10439-013-0890-7. View

14.

Schouten R, Lee R, Boyd M, Paquette S, Dvorak M, Kwon B . Intra-operative cone-beam CT (O-arm) and stereotactic navigation in acute spinal trauma surgery. J Clin Neurosci. 2012; 19(8):1137-43. DOI: 10.1016/j.jocn.2012.01.020. View

15.

Johnson J, Drazin D, King W, Kim T . Image-guided navigation and video-assisted thoracoscopic spine surgery: the second generation. Neurosurg Focus. 2014; 36(3):E8. DOI: 10.3171/2014.1.FOCUS13532. View

16.

Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I . Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng. 2014; 61(4):1295-304. DOI: 10.1109/TBME.2014.2301191. View

17.

Kockro R, Tseng Tsai Y, Ng I, Hwang P, Zhu C, Agusanto K . Dex-ray: augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery. 2009; 65(4):795-807. DOI: 10.1227/01.NEU.0000349918.36700.1C. View

18.

Rahmathulla G, Nottmeier E, Pirris S, Deen H, Pichelmann M . Intraoperative image-guided spinal navigation: technical pitfalls and their avoidance. Neurosurg Focus. 2014; 36(3):E3. DOI: 10.3171/2014.1.FOCUS13516. View

19.

Vankipuram M, Kahol K, McLaren A, Panchanathan S . A virtual reality simulator for orthopedic basic skills: a design and validation study. J Biomed Inform. 2010; 43(5):661-8. DOI: 10.1016/j.jbi.2010.05.016. View

20.

Cartiaux O, Banse X, Paul L, Francq B, Aubin C, Docquier P . Computer-assisted planning and navigation improves cutting accuracy during simulated bone tumor surgery of the pelvis. Comput Aided Surg. 2012; 18(1-2):19-26. DOI: 10.3109/10929088.2012.744096. View