Feasibility of Remote Administration of the Fundamentals of Laparoscopic Surgery (FLS) Skills Test

Overview

Journal Surg Endosc

Publisher Springer

Specialties Gastroenterology
General Surgery
Radiology

Date 2013 Sep 11

PMID 24018759

Citations 12

Authors

Allan Okrainec

Melina Vassiliou

Andrew Kapoor

Kristen Pitzul

Oscar Henao

Pepa Kaneva

Timothy Jackson

E Matt Ritter

Affiliations

Soon will be listed here.

Abstract

Background: Fundamentals of Laparoscopic Surgery (FLS) certification testing currently is offered at accredited test centers or at select surgical conferences. Maintaining these test centers requires considerable investment in human and financial resources. Additionally, it can be challenging for individuals outside North America to become FLS certified. The objective of this pilot study was to assess the feasibility of remotely administering and scoring the FLS examination using live videoconferencing compared with standard onsite testing.

Methods: This parallel mixed-methods study used both FLS scoring data and participant feedback to determine the barriers to feasibility of remote proctoring for the FLS examination. Participants were tested at two accredited FLS testing centers. An official FLS proctor administered and scored the FLS exam remotely while another onsite proctor provided a live score of participants' performance. Participant feedback was collected during testing. Interrater reliabilities of onsite and remote FLS scoring data were compared using intraclass correlation coefficients (ICCs). Participant feedback was analyzed using modified grounded theory to identify themes for barriers to feasibility.

Results: The scores of the remote and onsite proctors showed excellent interrater reliability in the total FLS (ICC 0.995, CI [0.985-0.998]). Several barriers led to critical errors in remote scoring, but most were accompanied by a solution incorporated into the study protocol. The most common barrier was the chain of custody for exam accessories.

Conclusion: The results of this pilot study suggest that remote administration of the FLS has the potential to decrease costs without altering test-taker scores or exam validity. Further research is required to validate protocols for remote and onsite proctors and to direct execution of these protocols in a controlled environment identical to current FLS test administration.

Citing Articles

Development and evaluation of an international teleproctoring program for bronchoscopic procedures.

Conway F, Tana A, Caneja C, Tonkin J, Avanzi L, Garner J iScience. 2025; 28(3):111653.

PMID: 40060899 PMC: 11889662. DOI: 10.1016/j.isci.2024.111653.

Virtual fundamentals of laparoscopic surgery (FLS) boot-camp using telesimulation: an educational solution during the COVID-19 pandemic.

Ramadan K, Chaiton K, Burke J, Labrakos D, Maeda A, Okrainec A Surg Endosc. 2023; 37(5):3926-3933.

PMID: 37067595 PMC: 10108785. DOI: 10.1007/s00464-023-09995-8.

Perceptions of the multidisciplinary operative team on intraoperative telecoaching among surgeons.

Shafa G, Masino C, Madani A, Okrainec A Surg Open Sci. 2022; 10:145-147.

PMID: 36193260 PMC: 9526219. DOI: 10.1016/j.sopen.2022.09.003.

Low-Cost "Telesimulation" Training Improves Real Patient Pediatric Shock Outcomes in India.

James E, Vyasam S, Venkatachalam S, Sanseau E, Cassidy K, Ramachandra G Front Pediatr. 2022; 10:904846.

PMID: 35967566 PMC: 9364444. DOI: 10.3389/fped.2022.904846.

Face-to-face versus distance learning of basic suturing skills in novice learners: a quantitative prospective randomized trial.

Zaghal A, Marley C, Rahhal S, Hassanieh J, Saadeh R, El-Rifai A BMC Med Educ. 2022; 22(1):290.

PMID: 35436934 PMC: 9014782. DOI: 10.1186/s12909-022-03353-3.

References

Eadie L, Seifalian A, Davidson B . Telemedicine in surgery. Br J Surg. 2003; 90(6):647-58. DOI: 10.1002/bjs.4168. View

Anvari M . Telesurgery: remote knowledge translation in clinical surgery. World J Surg. 2007; 31(8):1545-50. DOI: 10.1007/s00268-007-9076-5. View

Hiatt J, Shabot M, Phillips E, HAINES R, Grant T . Telesurgery. Acceptability of compressed video for remote surgical proctoring. Arch Surg. 1996; 131(4):396-401. DOI: 10.1001/archsurg.1996.01430160054009. View

Derossis A, Bothwell J, Sigman H, Fried G . The effect of practice on performance in a laparoscopic simulator. Surg Endosc. 1998; 12(9):1117-20. DOI: 10.1007/s004649900796. View

Anvari M . Impact of information technology on human resources in healthcare. Healthc Q. 2007; 10(4):84-8, 2. DOI: 10.12927/hcq.2007.19320. View

Peters J, Fried G, Swanstrom L, Soper N, Sillin L, Schirmer B . Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery. 2003; 135(1):21-7. DOI: 10.1016/s0039-6060(03)00156-9. View

Sroka G, Feldman L, Vassiliou M, Kaneva P, Fayez R, Fried G . Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg. 2010; 199(1):115-20. DOI: 10.1016/j.amjsurg.2009.07.035. View

McCluney A, Vassiliou M, Kaneva P, Cao J, Stanbridge D, Feldman L . FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc. 2007; 21(11):1991-5. DOI: 10.1007/s00464-007-9451-1. View

Derossis A, Fried G, Abrahamowicz M, Sigman H, Barkun J, Meakins J . Development of a model for training and evaluation of laparoscopic skills. Am J Surg. 1998; 175(6):482-7. DOI: 10.1016/s0002-9610(98)00080-4. View

10.

Soper N, Fried G . The fundamentals of laparoscopic surgery: its time has come. Bull Am Coll Surg. 2009; 93(9):30-2. View

11.

Schlachta C, Lefebvre K, Sorsdahl A, Jayaraman S . Mentoring and telementoring leads to effective incorporation of laparoscopic colon surgery. Surg Endosc. 2009; 24(4):841-4. DOI: 10.1007/s00464-009-0674-1. View

12.

Anvari M . Remote telepresence surgery: the Canadian experience. Surg Endosc. 2007; 21(4):537-41. DOI: 10.1007/s00464-006-9040-8. View

13.

Okrainec A, Henao O, Azzie G . Telesimulation: an effective method for teaching the fundamentals of laparoscopic surgery in resource-restricted countries. Surg Endosc. 2009; 24(2):417-22. DOI: 10.1007/s00464-009-0572-6. View

14.

Latifi R, Peck K, Satava R, Anvari M . Telepresence and telementoring in surgery. Stud Health Technol Inform. 2005; 104:200-6. View

15.

Vassiliou M, Ghitulescu G, Feldman L, Stanbridge D, Leffondre K, Sigman H . The MISTELS program to measure technical skill in laparoscopic surgery : evidence for reliability. Surg Endosc. 2006; 20(5):744-7. DOI: 10.1007/s00464-005-3008-y. View

16.

Fried G, Feldman L, Vassiliou M, Fraser S, Stanbridge D, Ghitulescu G . Proving the value of simulation in laparoscopic surgery. Ann Surg. 2004; 240(3):518-25. PMC: 1356442. DOI: 10.1097/01.sla.0000136941.46529.56. View