LapBot-Safe Chole: Validation of an Artificial Intelligence-powered Mobile Game App to Teach Safe Cholecystectomy

Overview

Journal Surg Endosc

Publisher Springer

Specialties Gastroenterology
General Surgery
Radiology

Date 2024 Jul 15

PMID 39009730

Authors

Ace St John

Muhammad Uzair Khalid

Caterina Masino

Mohammad Noroozi

Adnan Alseidi

Daniel A Hashimoto

Maria Altieri

Federico Serrot

Marta Kersten-Oertel

Amin Madani

Affiliations

Soon will be listed here.

Abstract

Background: Gaming can serve as an educational tool to allow trainees to practice surgical decision-making in a low-stakes environment. LapBot is a novel free interactive mobile game application that uses artificial intelligence (AI) to provide players with feedback on safe dissection during laparoscopic cholecystectomy (LC). This study aims to provide validity evidence for this mobile game.

Methods: Trainees and surgeons participated by downloading and playing LapBot on their smartphone. Players were presented with intraoperative LC scenes and required to locate their preferred location of dissection of the hepatocystic triangle. They received immediate accuracy scores and personalized feedback using an AI algorithm ("GoNoGoNet") that identifies safe/dangerous zones of dissection. Player scores were assessed globally and across training experience using non-parametric ANOVA. Three-month questionnaires were administered to assess the educational value of LapBot.

Results: A total of 903 participants from 64 countries played LapBot. As game difficulty increased, average scores (p < 0.0001) and confidence levels (p < 0.0001) decreased significantly. Scores were significantly positively correlated with players' case volume (p = 0.0002) and training level (p = 0.0003). Most agreed that LapBot should be incorporated as an adjunct into training programs (64.1%), as it improved their ability to reflect critically on feedback they receive during LC (47.5%) or while watching others perform LC (57.5%).

Conclusions: Serious games, such as LapBot, can be effective educational tools for deliberate practice and surgical coaching by promoting learner engagement and experiential learning. Our study demonstrates that players' scores were correlated to their level of expertise, and that after playing the game, most players perceived a significant educational value.

Citing Articles

Machine learning perioperative applications in visceral surgery: a narrative review.

Hossain I, Madani A, Laplante S Front Surg. 2024; 11:1493779.

PMID: 39539511 PMC: 11557547. DOI: 10.3389/fsurg.2024.1493779.

References

Flum D, Cheadle A, Prela C, Dellinger E, Chan L . Bile duct injury during cholecystectomy and survival in medicare beneficiaries. JAMA. 2003; 290(16):2168-73. DOI: 10.1001/jama.290.16.2168. View

Ejaz A, Spolverato G, Kim Y, Dodson R, Sicklick J, Pitt H . Long-term health-related quality of life after iatrogenic bile duct injury repair. J Am Coll Surg. 2014; 219(5):923-32.e10. DOI: 10.1016/j.jamcollsurg.2014.04.024. View

Tornqvist B, Zheng Z, Ye W, Waage A, Nilsson M . Long-term effects of iatrogenic bile duct injury during cholecystectomy. Clin Gastroenterol Hepatol. 2009; 7(9):1013-8. DOI: 10.1016/j.cgh.2009.05.014. View

Harboe K, Bardram L . The quality of cholecystectomy in Denmark: outcome and risk factors for 20,307 patients from the national database. Surg Endosc. 2010; 25(5):1630-41. DOI: 10.1007/s00464-010-1453-8. View

Waage A, Nilsson M . Iatrogenic bile duct injury: a population-based study of 152 776 cholecystectomies in the Swedish Inpatient Registry. Arch Surg. 2006; 141(12):1207-13. DOI: 10.1001/archsurg.141.12.1207. View

Flum D, Dellinger E, Cheadle A, Chan L, Koepsell T . Intraoperative cholangiography and risk of common bile duct injury during cholecystectomy. JAMA. 2003; 289(13):1639-44. DOI: 10.1001/jama.289.13.1639. View

Navez B, Ungureanu F, Michiels M, Claeys D, Muysoms F, Hubert C . Surgical management of acute cholecystitis: results of a 2-year prospective multicenter survey in Belgium. Surg Endosc. 2012; 26(9):2436-45. DOI: 10.1007/s00464-012-2206-7. View

Khan M, Howard T, Fogel E, Sherman S, McHenry L, Watkins J . Frequency of biliary complications after laparoscopic cholecystectomy detected by ERCP: experience at a large tertiary referral center. Gastrointest Endosc. 2007; 65(2):247-52. DOI: 10.1016/j.gie.2005.12.037. View

Way L, Stewart L, Gantert W, Liu K, Lee C, Whang K . Causes and prevention of laparoscopic bile duct injuries: analysis of 252 cases from a human factors and cognitive psychology perspective. Ann Surg. 2003; 237(4):460-9. PMC: 1514483. DOI: 10.1097/01.SLA.0000060680.92690.E9. View

10.

Madani A, Vassiliou M, Watanabe Y, Al-Halabi B, Al-Rowais M, Deckelbaum D . What Are the Principles That Guide Behaviors in the Operating Room?: Creating a Framework to Define and Measure Performance. Ann Surg. 2016; 265(2):255-267. DOI: 10.1097/SLA.0000000000001962. View

11.

Madani A, Watanabe Y, Feldman L, Vassiliou M, Barkun J, Fried G . Expert Intraoperative Judgment and Decision-Making: Defining the Cognitive Competencies for Safe Laparoscopic Cholecystectomy. J Am Coll Surg. 2015; 221(5):931-940.e8. DOI: 10.1016/j.jamcollsurg.2015.07.450. View

12.

Graafland M, Bemelman W, Schijven M . Game-based training improves the surgeon's situational awareness in the operation room: a randomized controlled trial. Surg Endosc. 2017; 31(10):4093-4101. PMC: 5636911. DOI: 10.1007/s00464-017-5456-6. View

13.

Ericsson K . Deliberate practice and acquisition of expert performance: a general overview. Acad Emerg Med. 2008; 15(11):988-94. DOI: 10.1111/j.1553-2712.2008.00227.x. View

14.

Moran G, Margolin E, Wang C, DeCastro G . Using gamification to increase resident engagement in surgical training: Our experience with a robotic surgery simulation league. Am J Surg. 2022; 224(1 Pt B):321-322. DOI: 10.1016/j.amjsurg.2022.01.020. View

15.

Madani A, Namazi B, Altieri M, Hashimoto D, Rivera A, Pucher P . Artificial Intelligence for Intraoperative Guidance: Using Semantic Segmentation to Identify Surgical Anatomy During Laparoscopic Cholecystectomy. Ann Surg. 2020; 276(2):363-369. PMC: 8186165. DOI: 10.1097/SLA.0000000000004594. View

16.

Ntakakis G, Plomariti C, Frantzidis C, Antoniou P, Bamidis P, Tsoulfas G . Exploring the use of virtual reality in surgical education. World J Transplant. 2023; 13(2):36-43. PMC: 9993190. DOI: 10.5500/wjt.v13.i2.36. View

17.

Rogers M, DeSantis A, Janjua H, Barry T, Kuo P . The future surgical training paradigm: Virtual reality and machine learning in surgical education. Surgery. 2020; 169(5):1250-1252. DOI: 10.1016/j.surg.2020.09.040. View

18.

Grober E, Jewett M . The concept and trajectory of "operative competence" in surgical training. Can J Surg. 2006; 49(4):238-40. PMC: 3207565. View

19.

Bhatti N, Cummings C . Competency in surgical residency training: defining and raising the bar. Acad Med. 2007; 82(6):569-73. DOI: 10.1097/ACM.0b013e3180555bfb. View

20.

Chandran V, Balakrishnan A, Rashid M, Pai Kulyadi G, Khan S, Devi E . Mobile applications in medical education: A systematic review and meta-analysis. PLoS One. 2022; 17(3):e0265927. PMC: 8947018. DOI: 10.1371/journal.pone.0265927. View