The Educational Game SonoQz Improves Diagnostic Performance in Ultrasound Assessment of Ovarian Tumors

Overview

Journal Acta Obstet Gynecol Scand

Publisher Wiley

Specialty Gynecology & Obstetrics

Date 2024 Jul 31

PMID 39082924

Authors

Erica Smedberg

Mans Akerlund

Mikael Andersson Franko

Elisabeth Epstein

Affiliations

Soon will be listed here.

Abstract

Introduction: Our objective was to determine whether the educational game SonoQz can improve diagnostic performance in ultrasound assessment of ovarian tumors.

Material And Methods: The SonoQz mobile application was developed as an educational tool for medical doctors to practice ultrasound assessment, based on still images of ovarian tumors. The game comprises images from 324 ovarian tumors, examined by an ultrasound expert prior to surgery. A training phase, where the participants assessed at least 200 cases in the SonoQz app, was preceded by a pretraining test, and followed by a posttraining test. Two equal tests (A and B), each consisting of 20 cases, were used as pre- and posttraining tests. Half the users took test A first, B second, and the remaining took the tests in the opposite order. Users were asked to classify the tumors (1) according to International Ovarian Tumor Analysis (IOTA) Simple Rules, (2) as benign or malignant, and (3) suggest a specific histological diagnosis. Logistic mixed models with fixed effects for pre- and posttraining tests, and crossed random effects for participants and cases, were used to determine any improvement in test scores, sensitivity, and specificity.

Results: Fifty-eight doctors from 19 medical centers participated. Comparing the pre- and posttraining test, the median of correctly classified cases, in Simple Rules assessment increased from 72% to 83%, p < 0.001; in classifying the lesion as benign or malignant tumors from 86% to 95%, p < 0.001; and in making a specific diagnosis from 43% to 63%, p < 0.001. When classifying tumors as benign or malignant, at an unchanged level of sensitivity (98% vs. 97%, p = 0.157), the specificity increased from 70% to 89%, p < 0.001.

Conclusions: Our results indicate that the educational game SonoQz is an effective tool that may improve diagnostic performance in assessing ovarian tumors, specifically by reducing the number of false positives while maintaining high sensitivity.

Citing Articles

The educational game SonoQz improves diagnostic performance in ultrasound assessment of ovarian tumors.

Smedberg E, Akerlund M, Andersson Franko M, Epstein E Acta Obstet Gynecol Scand. 2024; 103(10):2053-2060.

PMID: 39082924 PMC: 11426211. DOI: 10.1111/aogs.14906.

References

Sharma A, Ilyas M, Maganty N, Zhang N, Pittelkow M . An effective game-based learning intervention for improving melanoma recognition. J Am Acad Dermatol. 2018; 79(3):587-588. DOI: 10.1016/j.jaad.2018.02.068. View

Tolsgaard M, Ringsted C, Rosthoj S, Norgaard L, Moller L, la Cour Freiesleben N . The Effects of Simulation-based Transvaginal Ultrasound Training on Quality and Efficiency of Care: A Multicenter Single-blind Randomized Trial. Ann Surg. 2017; 265(3):630-637. DOI: 10.1097/SLA.0000000000001656. View

Engelen M, Kos H, Willemse P, Aalders J, de Vries E, Schaapveld M . Surgery by consultant gynecologic oncologists improves survival in patients with ovarian carcinoma. Cancer. 2005; 106(3):589-98. DOI: 10.1002/cncr.21616. View

Akl E, Pretorius R, Sackett K, Erdley W, Bhoopathi P, Alfarah Z . The effect of educational games on medical students' learning outcomes: a systematic review: BEME Guide No 14. Med Teach. 2010; 32(1):16-27. DOI: 10.3109/01421590903473969. View

Diehl L, Souza R, Gordan P, Esteves R, Coelho I . InsuOnline, an Electronic Game for Medical Education on Insulin Therapy: A Randomized Controlled Trial With Primary Care Physicians. J Med Internet Res. 2017; 19(3):e72. PMC: 5364323. DOI: 10.2196/jmir.6944. View

Timmerman D, Testa A, Bourne T, Ameye L, Jurkovic D, Van Holsbeke C . Simple ultrasound-based rules for the diagnosis of ovarian cancer. Ultrasound Obstet Gynecol. 2008; 31(6):681-90. DOI: 10.1002/uog.5365. View

Valentin L . Prospective cross-validation of Doppler ultrasound examination and gray-scale ultrasound imaging for discrimination of benign and malignant pelvic masses. Ultrasound Obstet Gynecol. 1999; 14(4):273-83. DOI: 10.1046/j.1469-0705.1999.14040273.x. View

Gorbanev I, Agudelo-Londono S, Gonzalez R, Cortes A, Pomares A, Delgadillo V . A systematic review of serious games in medical education: quality of evidence and pedagogical strategy. Med Educ Online. 2018; 23(1):1438718. PMC: 5827764. DOI: 10.1080/10872981.2018.1438718. View

Jaunay L, Zerr P, Peguin L, Renouard L, Ivanoff A, Picard H . Development and Evaluation of a New Serious Game for Continuing Medical Education of General Practitioners (Hygie): Double-Blinded Randomized Controlled Trial. J Med Internet Res. 2019; 21(11):e12669. PMC: 6893567. DOI: 10.2196/12669. View

10.

Wang R, DeMaria Jr S, Goldberg A, Katz D . A Systematic Review of Serious Games in Training Health Care Professionals. Simul Healthc. 2015; 11(1):41-51. DOI: 10.1097/SIH.0000000000000118. View

11.

Timmerman D, Schwarzler P, COLLINS W, Claerhout F, Coenen M, Amant F . Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience. Ultrasound Obstet Gynecol. 1999; 13(1):11-6. DOI: 10.1046/j.1469-0705.1999.13010011.x. View

12.

. Minimum training requirements for the practice of Medical Ultrasound in Europe. Ultraschall Med. 2010; 31(4):426-7. DOI: 10.1055/s-0030-1263214. View

13.

Meys E, Kaijser J, Kruitwagen R, Slangen B, Van Calster B, Aertgeerts B . Subjective assessment versus ultrasound models to diagnose ovarian cancer: A systematic review and meta-analysis. Eur J Cancer. 2016; 58:17-29. DOI: 10.1016/j.ejca.2016.01.007. View

14.

Andreasen L, Tabor A, Norgaard L, Ringsted C, Sandager P, Rosthoj S . Multicenter randomized trial exploring effects of simulation-based ultrasound training on obstetricians' diagnostic accuracy: value for experienced operators. Ultrasound Obstet Gynecol. 2019; 55(4):523-529. DOI: 10.1002/uog.20362. View

15.

Smedberg E, Akerlund M, Andersson Franko M, Epstein E . The educational game SonoQz improves diagnostic performance in ultrasound assessment of ovarian tumors. Acta Obstet Gynecol Scand. 2024; 103(10):2053-2060. PMC: 11426211. DOI: 10.1111/aogs.14906. View

16.

AbdulMajed H, Park Y, Tekian A . Assessment of educational games for health professions: a systematic review of trends and outcomes. Med Teach. 2015; 37 Suppl 1:S27-32. DOI: 10.3109/0142159X.2015.1006609. View

17.

Froyman W, Wynants L, Landolfo C, Bourne T, Valentin L, Testa A . Validation of the Performance of International Ovarian Tumor Analysis (IOTA) Methods in the Diagnosis of Early Stage Ovarian Cancer in a Non-Screening Population. Diagnostics (Basel). 2017; 7(2). PMC: 5489952. DOI: 10.3390/diagnostics7020032. View

18.

Aggarwal R, Ranganathan P . Study designs: Part 4 - Interventional studies. Perspect Clin Res. 2019; 10(3):137-139. PMC: 6647894. DOI: 10.4103/picr.PICR_91_19. View

19.

Froyman W, Landolfo C, De Cock B, Wynants L, Sladkevicius P, Testa A . Risk of complications in patients with conservatively managed ovarian tumours (IOTA5): a 2-year interim analysis of a multicentre, prospective, cohort study. Lancet Oncol. 2019; 20(3):448-458. DOI: 10.1016/S1470-2045(18)30837-4. View

20.

Van Holsbeke C, Daemen A, Yazbek J, Holland T, Bourne T, Mesens T . Ultrasound experience substantially impacts on diagnostic performance and confidence when adnexal masses are classified using pattern recognition. Gynecol Obstet Invest. 2009; 69(3):160-8. DOI: 10.1159/000265012. View