Construct Validity: Experts and Novices Performing on the Xitact LS500 Laparoscopy Simulator

Overview

Journal Surg Endosc

Publisher Springer

Specialties Gastroenterology
General Surgery
Radiology

Date 2003 Feb 13

PMID 12582752

Citations 41

Authors

M Schijven

J Jakimowicz

Affiliations

Soon will be listed here.

Abstract

Background: This study was undertaken to establish construct validity of the Xitact LS500, a virtual reality laparoscopic cholecystectomy simulator. The primary research statement is: "The clip-and-cut task on the Xitact LS500 virtual reality laparoscopic cholecystectomy simulator mimics the surgical procedure of the clipping and cutting of the cystic duct and artery during the laparoscopic cholecystectomy adequately."

Methods: According to the level of experience of the surgeon, an "expert group opinion" was formed resulting from 37 surgeons having performed over 100 laparoscopic cholecystectomies, and a "novice group opinion" was formed resulting of 37 surgeons having no experience at all with performing laparoscopic cholecystectomy. Participants received an instructed hands-on "tour" on the Xitact simulator and performed three formal simulation runs.

Results: The "novice group" is younger and more surgeons are female. Performance scores in the "expert" group are significantly higher on the second (p value 0.011) and third (p value 0.005) run, compared to the novices' scores. Experts are significantly faster on completion of all three runs. There is an increase in score over runs in both groups, which is statistically significant in the "expert group." Less than one-third of surgeons in either group are able to correctly predict their performance score as generated by Xitact. Both "experts" and "novices" feel it is useful to train with Xitact LS500 in the surgical curriculum.

Conclusions: Three hypotheses, formulated to operationalize the primary research statement, could be answered affirmatively. Although further validation studies are needed, the Xitact LS500 simulator seems to be able to discriminate between expert and novice surgeons in this research setting, and thus the construct for this setting is considered to be valid.

Citing Articles

Comparison of Laparoscopic Steerable Instruments Performed by Expert Surgeons and Novices.

Lacitignola L, Trisciuzzi R, Imperante A, Fracassi L, Crovace A, Staffieri F Vet Sci. 2020; 7(3).

PMID: 32942765 PMC: 7558073. DOI: 10.3390/vetsci7030135.

Use of a Low-Cost Portable 3D Virtual Reality Gesture-Mediated Simulator for Training and Learning Basic Psychomotor Skills in Minimally Invasive Surgery: Development and Content Validity Study.

Alvarez-Lopez F, Maina M, Saigi-Rubio F J Med Internet Res. 2020; 22(7):e17491.

PMID: 32673217 PMC: 7388055. DOI: 10.2196/17491.

The Heidelberg VR Score: development and validation of a composite score for laparoscopic virtual reality training.

Schmidt M, Kowalewski K, Schmidt M, Wennberg E, Garrow C, Paik S Surg Endosc. 2018; 33(7):2093-2103.

PMID: 30327918 DOI: 10.1007/s00464-018-6480-x.

Evaluation of robotic minimally invasive surgical skills using motion studies.

Jun S, Sathia Narayanan M, Singhal P, Garimella S, Krovi V J Robot Surg. 2016; 7(3):241-9.

PMID: 27000920 DOI: 10.1007/s11701-013-0419-y.

Validation of a virtual reality-based simulator for shoulder arthroscopy.

Rahm S, Germann M, Hingsammer A, Wieser K, Gerber C Knee Surg Sports Traumatol Arthrosc. 2016; 24(5):1730-7.

PMID: 26860098 DOI: 10.1007/s00167-016-4022-4.

References

Whitney J . Validity and reliability: basic research concepts. J Wound Ostomy Continence Nurs. 2000; 26(5):240. DOI: 10.1097/00152192-199909000-00006. View

Paisley A, Baldwin P, Paterson-Brown S . Validity of surgical simulation for the assessment of operative skill. Br J Surg. 2001; 88(11):1525-32. DOI: 10.1046/j.0007-1323.2001.01880.x. View

Gallagher A, McClure N, McGuigan J, Crothers I, Browning J . Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST VR). Endoscopy. 1999; 31(4):310-3. DOI: 10.1055/s-1999-15. View

Wilson M, Middlebrook A, Sutton C, Stone R, McCloy R . MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. Ann R Coll Surg Engl. 1998; 79(6):403-4. PMC: 2502952. View

Reznick R . Teaching and testing technical skills. Am J Surg. 1993; 165(3):358-61. DOI: 10.1016/s0002-9610(05)80843-8. View

Prystowsky J, Regehr G, Rogers D, Loan J, Hiemenz L, Smith K . A virtual reality module for intravenous catheter placement. Am J Surg. 1999; 177(2):171-5. DOI: 10.1016/s0002-9610(98)00328-6. View

Jordan J, Gallagher A, McGuigan J, McGlade K, McClure N . A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition. Am J Surg. 2000; 180(3):208-11. DOI: 10.1016/s0002-9610(00)00469-4. View

Gaberson K . Measurement reliability and validity. AORN J. 1997; 66(6):1092-4. DOI: 10.1016/s0001-2092(06)62551-9. View

Ault G, Reznick R, MacRae H, Leadbetter W, DaRosa D, Joehl R . Exporting a technical skills evaluation technology to other sites. Am J Surg. 2001; 182(3):254-6. DOI: 10.1016/s0002-9610(01)00700-0. View

10.

Coleman J, Nduka C, Darzi A . Virtual reality and laparoscopic surgery. Br J Surg. 1994; 81(12):1709-11. DOI: 10.1002/bjs.1800811204. View

11.

Paisley A, Baldwin P, Paterson-Brown S . Feasibility, reliability and validity of a new assessment form for use with basic surgical trainees. Am J Surg. 2001; 182(1):24-9. DOI: 10.1016/s0002-9610(01)00647-x. View

12.

Torkington J, Smith S, Rees B, Darzi A . Skill transfer from virtual reality to a real laparoscopic task. Surg Endosc. 2001; 15(10):1076-9. DOI: 10.1007/s004640000233. View

13.

McNatt S, Smith C . A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons. Surg Endosc. 2001; 15(10):1085-9. DOI: 10.1007/s004640080022. View

14.

Derossis A, Antoniuk M, Fried G . Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg. 1999; 42(4):293-6. PMC: 3789000. View

15.

Ota D, Loftin B, Saito T, Lea R, Keller J . Virtual reality in surgical education. Comput Biol Med. 1995; 25(2):127-37. DOI: 10.1016/0010-4825(94)00009-f. View

16.

Karras D . Statistical methodology: II. Reliability and validity assessment in study design, Part B. Acad Emerg Med. 1997; 4(2):144-7. DOI: 10.1111/j.1553-2712.1997.tb03723.x. View

17.

Grantcharov T, Rosenberg J, Pahle E, Funch-Jensen P . Virtual reality computer simulation. Surg Endosc. 2001; 15(3):242-4. DOI: 10.1007/s004640090008. View

18.

Reznick R, Regehr G, MacRae H, Martin J, McCulloch W . Testing technical skill via an innovative "bench station" examination. Am J Surg. 1997; 173(3):226-30. DOI: 10.1016/s0002-9610(97)89597-9. View

19.

Satava R . Accomplishments and challenges of surgical simulation. Surg Endosc. 2001; 15(3):232-41. DOI: 10.1007/s004640000369. View

20.

Taffinder N, Sutton C, Fishwick R, McManus I, Darzi A . Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform. 1997; 50:124-30. View