The McGill Simulator for Endoscopic Sinus Surgery (MSESS): a Validation Study

Overview

Journal J Otolaryngol Head Neck Surg

Publisher Sage Publications

Specialties General Surgery
Otorhinolaryngology

Date 2015 May 1

PMID 25927463

Citations 14

Authors

Rickul Varshney

Saul Frenkiel

Lily H P Nguyen

Meredith Young

Rolando Del Maestro

Anthony Zeitouni

Elias Saad

W Robert J Funnell

Marc A Tewfik

Affiliations

Soon will be listed here.

Abstract

Background: Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.

Methods: 10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.

Results: The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97 ± 0.29 and 8.57 ± 0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (p < 0.05), efficiency (p < 0.01) and safety (p < 0.05).

Conclusion: The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.

Citing Articles

Does Total Turbinectomy Always Lead to Empty Nose Syndrome? A Computational Virtual Surgery Study.

Odeh A, Wen R, Wu Z, Schneller A, Root Z, Hittle B Laryngoscope. 2024; 135(2):562-569.

PMID: 39305211 PMC: 11725719. DOI: 10.1002/lary.31757.

Safe surgical training: evaluation of a national functional endoscopic sinus surgery model simulation course using the Kirkpatrick evaluation model.

Gillanders S, McHugh A, Lacy P, Thornton M Ir J Med Sci. 2023; 192(6):3039-3042.

PMID: 36800053 PMC: 9936104. DOI: 10.1007/s11845-023-03309-6.

Construct and Validation of a Three-Dimensional Physical Model for Training in Transnasal Office Procedures.

Bright R, Varghese L, Kurien R Indian J Otolaryngol Head Neck Surg. 2022; 74(Suppl 2):1638-1645.

PMID: 36452823 PMC: 9702433. DOI: 10.1007/s12070-021-02775-7.

Virtual Reality in the Neurosciences: Current Practice and Future Directions.

Scott H, Griffin C, Coggins W, Elberson B, Abdeldayem M, Virmani T Front Surg. 2022; 8:807195.

PMID: 35252318 PMC: 8894248. DOI: 10.3389/fsurg.2021.807195.

Research Hotspots and Trend Exploration on the Clinical Translational Outcome of Simulation-Based Medical Education: A 10-Year Scientific Bibliometric Analysis From 2011 to 2021.

Yao S, Tang Y, Yi C, Xiao Y Front Med (Lausanne). 2022; 8:801277.

PMID: 35198570 PMC: 8860229. DOI: 10.3389/fmed.2021.801277.

References

Tolsdorff B, Pommert A, Hohne K, Petersik A, Pflesser B, Tiede U . Virtual reality: a new paranasal sinus surgery simulator. Laryngoscope. 2009; 120(2):420-6. DOI: 10.1002/lary.20676. View

Park J, MacRae H, Musselman L, Rossos P, Hamstra S, Wolman S . Randomized controlled trial of virtual reality simulator training: transfer to live patients. Am J Surg. 2007; 194(2):205-11. DOI: 10.1016/j.amjsurg.2006.11.032. View

Bakker N, Fokkens W, Grimbergen C . Investigation of training needs for functional endoscopic sinus surgery (FESS). Rhinology. 2005; 43(2):104-8. View

Fried M, Satava R, Weghorst S, Gallagher A, Sasaki C, Ross D . Identifying and reducing errors with surgical simulation. Qual Saf Health Care. 2004; 13 Suppl 1:i19-26. PMC: 1765795. DOI: 10.1136/qhc.13.suppl_1.i19. View

Fried M, Sadoughi B, Gibber M, Jacobs J, Lebowitz R, Ross D . From virtual reality to the operating room: the endoscopic sinus surgery simulator experiment. Otolaryngol Head Neck Surg. 2010; 142(2):202-7. DOI: 10.1016/j.otohns.2009.11.023. View

Jensen U, Jensen J, Olivecrona G, Ahlberg G, Tornvall P . Technical skills assessment in a coronary angiography simulator for construct validation. Simul Healthc. 2013; 8(5):324-8. DOI: 10.1097/SIH.0b013e31828fdedc. View

Seymour N, Gallagher A, Roman S, OBrien M, Bansal V, Andersen D . Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002; 236(4):458-63; discussion 463-4. PMC: 1422600. DOI: 10.1097/00000658-200210000-00008. View

Wiet G, Stredney D, Wan D . Training and simulation in otolaryngology. Otolaryngol Clin North Am. 2011; 44(6):1333-50, viii-ix. PMC: 3204194. DOI: 10.1016/j.otc.2011.08.009. View

Zhao Y, Kennedy G, Yukawa K, Pyman B, OLeary S . Can virtual reality simulator be used as a training aid to improve cadaver temporal bone dissection? Results of a randomized blinded control trial. Laryngoscope. 2011; 121(4):831-7. DOI: 10.1002/lary.21287. View

10.

Steehler M, Pfisterer M, Na H, Hesham H, Pehlivanova M, Malekzadeh S . Face, content, and construct validity of a low-cost sinus surgery task trainer. Otolaryngol Head Neck Surg. 2011; 146(3):504-9. DOI: 10.1177/0194599811430187. View

11.

Hogle N, Widmann W, Ude A, Hardy M, Fowler D . Does training novices to criteria and does rapid acquisition of skills on laparoscopic simulators have predictive validity or are we just playing video games?. J Surg Educ. 2008; 65(6):431-5. DOI: 10.1016/j.jsurg.2008.05.008. View

12.

Schaefer 3rd J . Simulators and difficult airway management skills. Paediatr Anaesth. 2004; 14(1):28-37. DOI: 10.1046/j.1460-9592.2003.01204.x. View

13.

Burden C, Preshaw J, White P, Draycott T, Grant S, Fox R . Validation of virtual reality simulation for obstetric ultrasonography: a prospective cross-sectional study. Simul Healthc. 2012; 7(5):269-73. DOI: 10.1097/SIH.0b013e3182611844. View

14.

Francis H, Malik M, Diaz Voss Varela D, Barffour M, Chien W, Carey J . Technical skills improve after practice on virtual-reality temporal bone simulator. Laryngoscope. 2012; 122(6):1385-91. DOI: 10.1002/lary.22378. View

15.

Downing S . Validity: on meaningful interpretation of assessment data. Med Educ. 2003; 37(9):830-7. DOI: 10.1046/j.1365-2923.2003.01594.x. View

16.

Rivard J, Vergis A, Unger B, Hardy K, Andrew C, Gillman L . Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator. Surg Endosc. 2014; 28(6):1921-8. DOI: 10.1007/s00464-013-3414-5. View

17.

Delorme S, Laroche D, DiRaddo R, Del Maestro R . NeuroTouch: a physics-based virtual simulator for cranial microneurosurgery training. Neurosurgery. 2012; 71(1 Suppl Operative):32-42. DOI: 10.1227/NEU.0b013e318249c744. View

18.

Beyer L, Troyer J, Mancini J, Bladou F, Berdah S, Karsenty G . Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. Am J Surg. 2011; 202(3):265-72. DOI: 10.1016/j.amjsurg.2010.11.008. View

19.

Rosseau G, Bailes J, Del Maestro R, Cabral A, Choudhury N, Comas O . The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. Neurosurgery. 2013; 73 Suppl 1:85-93. DOI: 10.1227/NEU.0000000000000112. View

20.

Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A . Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg. 2005; 131(3):217-21. DOI: 10.1001/archotol.131.3.217. View