Educational Effects of Simulation and Non-Simulation Training in Airway Management According to Levels of the Kirkpatrick Model: A Systematic Review and Network Meta-Analysis

Overview

Journal J Clin Med

Specialty General Medicine

Date 2022 Oct 14

PMID 36233481

Authors

Koichi Ando

Akane Ando

Akihiko Tanaka

Shinji Koba

Hironori Sagara

Affiliations

Soon will be listed here.

Abstract

There is insufficient validation of the effectiveness of simulation-based training (Sim) or non-simulation-based training (non-Sim) for teaching airway management to healthcare professionals within the literature. We thus conducted a network meta-analysis comparing the effectiveness of Sim, non-Sim, and no educational intervention (NI) for airway management. The primary endpoints were knowledge scores (KnS) and behavioral performance scores (BpS) corresponding to assessments at levels 2 and 3 of the Kirkpatrick model, respectively. Effect sizes were expressed as standardized mean differences (Std. MD) and 95% credible intervals (CrIs). Regarding KnS, the educational effects of Sim and non-Sim were significantly improved compared to those of NI (Std. MD [95% CI]: 1.110 [0.903-1.316] and 0.819 [0.209-1.429], respectively); there was no significant difference between Sim and non-Sim. The educational effect of Sim in BpS was significantly improved compared to that of non-Sim and NI (0.850 [0.015-1.691] and 0.660 [0.241-1.076]); there were no differences between non-Sim and NI. Surface under the cumulative rank curve values demonstrated that Sim ranked highest in efficacy for KnS and BpS. This study provides valuable information regarding the educational efficacy of Sim and non-Sim in airway management. Larger randomized controlled trials are needed to confirm these findings.

Citing Articles

Training and assessment of skills in flexible optical intubation - Protocol of a scoping review.

Jokinen J, Cantby C, Torkov A, Brochner A, Konge L, Nielsen A Acta Anaesthesiol Scand. 2025; 69(4):e70019.

PMID: 40066696 PMC: 11894585. DOI: 10.1111/aas.70019.

Simulation in airway management teaching and training.

Maurya I, Ahmed S, Garg R Indian J Anaesth. 2024; 68(1):52-57.

PMID: 38406347 PMC: 10893796. DOI: 10.4103/ija.ija_1234_23.

References

Marshall S, Chrimes N . Time for a breath of fresh air: Rethinking training in airway management. Anaesthesia. 2016; 71(11):1259-1264. PMC: 5129551. DOI: 10.1111/anae.13665. View

Hutton B, Salanti G, Caldwell D, Chaimani A, Schmid C, Cameron C . The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015; 162(11):777-84. DOI: 10.7326/M14-2385. View

Salanti G, Ades A, Ioannidis J . Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2010; 64(2):163-71. DOI: 10.1016/j.jclinepi.2010.03.016. View

Han M, Lee J, Shin Y, Son J, Choi E, Oh Y . Effects of a simulated emergency airway management education program on the self-efficacy and clinical performance of intensive care unit nurses. Jpn J Nurs Sci. 2017; 15(3):258-266. DOI: 10.1111/jjns.12195. View

Nadel F, LAVELLE J, Fein J, Giardino A, Decker J, Durbin D . Teaching resuscitation to pediatric residents: the effects of an intervention. Arch Pediatr Adolesc Med. 2000; 154(10):1049-54. DOI: 10.1001/archpedi.154.10.1049. View

Modell J, Cantwell S, Hardcastle J, Robertson S, Pablo L . Using the human patient simulator to educate students of veterinary medicine. J Vet Med Educ. 2002; 29(2):111-6. DOI: 10.3138/jvme.29.2.111. View

Daniel S . Education and the COVID-19 pandemic. Prospects (Paris). 2020; 49(1-2):91-96. PMC: 7167396. DOI: 10.1007/s11125-020-09464-3. View

Cheney F . The American Society of Anesthesiologists Closed Claims Project: what have we learned, how has it affected practice, and how will it affect practice in the future?. Anesthesiology. 1999; 91(2):552-6. DOI: 10.1097/00000542-199908000-00030. View

Dias S, Sutton A, Welton N, Ades A . Evidence synthesis for decision making 3: heterogeneity--subgroups, meta-regression, bias, and bias-adjustment. Med Decis Making. 2013; 33(5):618-40. PMC: 3704206. DOI: 10.1177/0272989X13485157. View

10.

Hoaglin D, Hawkins N, Jansen J, Scott D, Itzler R, Cappelleri J . Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011; 14(4):429-37. DOI: 10.1016/j.jval.2011.01.011. View

11.

Rose S . Medical Student Education in the Time of COVID-19. JAMA. 2020; 323(21):2131-2132. DOI: 10.1001/jama.2020.5227. View

12.

Jansen J, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N . Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011; 14(4):417-28. DOI: 10.1016/j.jval.2011.04.002. View

13.

Rowe R, Cohen R . An evaluation of a virtual reality airway simulator. Anesth Analg. 2002; 95(1):62-6, table of contents. DOI: 10.1097/00000539-200207000-00011. View

14.

Lopez-Belmonte J, Segura-Robles A, Moreno-Guerrero A, Parra-Gonzalez M . Projection of E-Learning in Higher Education: A Study of Its Scientific Production in Web of Science. Eur J Investig Health Psychol Educ. 2021; 11(1):20-32. PMC: 8314331. DOI: 10.3390/ejihpe11010003. View

15.

Wenk M, Waurick R, Schotes D, Wenk M, Gerdes C, Van Aken H . Simulation-based medical education is no better than problem-based discussions and induces misjudgment in self-assessment. Adv Health Sci Educ Theory Pract. 2008; 14(2):159-71. DOI: 10.1007/s10459-008-9098-2. View

16.

Liberati A, Altman D, Tetzlaff J, Mulrow C, Gotzsche P, Ioannidis J . The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009; 6(7):e1000100. PMC: 2707010. DOI: 10.1371/journal.pmed.1000100. View

17.

Ahmed H, Allaf M, Elghazaly H . COVID-19 and medical education. Lancet Infect Dis. 2020; 20(7):777-778. PMC: 7270510. DOI: 10.1016/S1473-3099(20)30226-7. View

18.

Dias S, Welton N, Sutton A, Caldwell D, Lu G, Ades A . Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Making. 2013; 33(5):641-56. PMC: 3704208. DOI: 10.1177/0272989X12455847. View

19.

Cernasev A, Desai M, Jonkman L, Connor S, Ware N, Sekar M . Student Pharmacists during the Pandemic: Development of a COVID-19 Knowledge, Attitudes, and Practices (COVKAP) Survey. Pharmacy (Basel). 2021; 9(4). PMC: 8544658. DOI: 10.3390/pharmacy9040159. View

20.

Dias S, Sutton A, Ades A, Welton N . Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making. 2012; 33(5):607-17. PMC: 3704203. DOI: 10.1177/0272989X12458724. View