A Mixed-Methods Realist Analysis of an Interdisciplinary Simulation Intervention for Psychiatry Residents

Overview

Journal Acad Psychiatry

Publisher Springer

Specialty Psychiatry

Date 2021 Oct 6

PMID 34613598

Citations 2

Authors

Paige Durling

Jihane Henni

Dean Mrozowich

Joanna Rankin

Amber Barlow

Rachel Grimminck

Affiliations

Soon will be listed here.

Abstract

Objectives: Simulation research in postgraduate psychiatry remains limited, with minimal studies on interdisciplinary involvement and mechanisms of change. To address these gaps, the authors implemented a mixed-methods realist analysis of an interdisciplinary simulation intervention administered to psychiatry residents.

Methods: The University of Calgary implemented a simulation intervention for psychiatry residents. Eight junior residents participated in or observed 4 scenarios and eighteen senior residents participated in or observed 8 scenarios. Scenarios lasted 15 minutes with a pre-simulation orientation and post-scenario debrief. Most scenarios involved interdisciplinary staff. Scenarios included agitated and suicidal patients; treatment-related emergencies; and challenging conversations. All residents completed pre- and post-simulation surveys reporting confidence levels. Changes in confidence were analyzed using paired t tests and differences between junior and senior residents' confidence using ANOVA. Eleven residents participated in 2 focus groups. Transcripts were analyzed using a constant comparative model to identify contexts, mechanisms, outcomes, and the relationship between these realist categories. Key themes were extracted using generic theme analysis.

Results: Aggregated survey data demonstrated statistically significant improvements in self-reported confidence for 7 of 8 proposed scenarios, with variations in confidence outcomes between junior and senior residents. Four themes emerged: (1) How Simulations Facilitate Learning, (2) The Role of Pre-simulation Instructions, (3) Factors Facilitating Confidence, (4) Positive Effects of Interdisciplinary Involvement.

Conclusions: This study identifies possible mechanisms for residents' self-reported improvements in learning and confidence, which may help programs tailor interventions. Furthermore, this study suggests there may be benefits to interdisciplinary simulations, with self-reported outcomes of improved collaboration and safety planning.

Citing Articles

Inter-Professional Education Interventions, and Practice Outcomes Related to Healthcare Setting and Patients Within Mental Healthcare: A Scoping Review.

Chew Q, Maniam E, Sim K Perspect Med Educ. 2024; 13(1):108-118.

PMID: 38406650 PMC: 10885830. DOI: 10.5334/pme.1084.

Educational Approaches Using Simulation for Psychiatric Risk Assessment: a Scoping Review.

Ghahari D, Chaharlangi D, Bonato S, Sliekers S, Sockalingam S, Ali A Acad Psychiatry. 2023; 48(1):61-70.

PMID: 37584887 DOI: 10.1007/s40596-023-01836-z.

References

McNaughton N, Ravitz P, Wadell A, Hodges B . Psychiatric education and simulation: a review of the literature. Can J Psychiatry. 2008; 53(2):85-93. DOI: 10.1177/070674370805300203. View

Abdool P, Nirula L, Bonato S, Rajji T, Silver I . Simulation in Undergraduate Psychiatry: Exploring the Depth of Learner Engagement. Acad Psychiatry. 2016; 41(2):251-261. DOI: 10.1007/s40596-016-0633-9. View

Calderon A, Blackmore C, Williams B, Chawla K, Nelson-Peterson D, Ingraham M . Transforming Ward Rounds Through Rounding-in-Flow. J Grad Med Educ. 2015; 6(4):750-5. PMC: 4477576. DOI: 10.4300/JGME-D-13-00324.1. View

Okuda Y, Bryson E, DeMaria Jr S, Jacobson L, Quinones J, Shen B . The utility of simulation in medical education: what is the evidence?. Mt Sinai J Med. 2009; 76(4):330-43. DOI: 10.1002/msj.20127. View

Chan W, Wu T, Hsieh M, Chou T, Wong C, Fang J . Students' view upon graduation: a survey of medical education in Taiwan. BMC Med Educ. 2012; 12:127. PMC: 3546303. DOI: 10.1186/1472-6920-12-127. View

Graham A, McAleer S . An overview of realist evaluation for simulation-based education. Adv Simul (Lond). 2018; 3:13. PMC: 6050705. DOI: 10.1186/s41077-018-0073-6. View

Raleigh M, Wilson G, Moss D, Reineke-Piper K, Walden J, Fisher D . Same Content, Different Methods: Comparing Lecture, Engaged Classroom, and Simulation. Fam Med. 2018; 50(2):100-105. DOI: 10.22454/FamMed.2018.222922. View

Thomson A, Cross S, Key S, Jaye P, Iversen A . How we developed an emergency psychiatry training course for new residents using principles of high-fidelity simulation. Med Teach. 2013; 35(10):797-800. DOI: 10.3109/0142159X.2013.803522. View

Issenberg S, McGaghie W, Petrusa E, Gordon D, Scalese R . Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005; 27(1):10-28. DOI: 10.1080/01421590500046924. View

10.

Bullard M, Weekes A, Cordle R, Fox S, Wares C, Heffner A . A Mixed-methods Comparison of Participant and Observer Learner Roles in Simulation Education. AEM Educ Train. 2019; 3(1):20-32. PMC: 6339532. DOI: 10.1002/aet2.10310. View

11.

Reime M, Johnsgaard T, Kvam F, Aarflot M, Engeberg J, Breivik M . Learning by viewing versus learning by doing: A comparative study of observer and participant experiences during an interprofessional simulation training. J Interprof Care. 2016; 31(1):51-58. DOI: 10.1080/13561820.2016.1233390. View

12.

ORegan S, Molloy E, Watterson L, Nestel D . Observer roles that optimise learning in healthcare simulation education: a systematic review. Adv Simul (Lond). 2018; 1:4. PMC: 5796608. DOI: 10.1186/s41077-015-0004-8. View

13.

Bommer C, Sullivan S, Campbell K, Ahola Z, Agarwal S, ORourke A . Pre-simulation orientation for medical trainees: An approach to decrease anxiety and improve confidence and performance. Am J Surg. 2017; 215(2):266-271. DOI: 10.1016/j.amjsurg.2017.09.038. View

14.

Morgan P, Cleave-Hogg D . Comparison between medical students' experience, confidence and competence. Med Educ. 2002; 36(6):534-9. DOI: 10.1046/j.1365-2923.2002.01228.x. View

15.

Macdougall L, Martin R, McCallum I, Grogan E . Simulation and stress: acceptable to students and not confidence-busting. Clin Teach. 2013; 10(1):38-41. DOI: 10.1111/j.1743-498X.2012.00624.x. View

16.

Stewart J, OHalloran C, Barton J, Singleton S, Harrigan P, Spencer J . Clarifying the concepts of confidence and competence to produce appropriate self-evaluation measurement scales. Med Educ. 2000; 34(11):903-9. DOI: 10.1046/j.1365-2923.2000.00728.x. View

17.

Barnsley L, Lyon P, Ralston S, Hibbert E, Cunningham I, Gordon F . Clinical skills in junior medical officers: a comparison of self-reported confidence and observed competence. Med Educ. 2004; 38(4):358-67. DOI: 10.1046/j.1365-2923.2004.01773.x. View

18.

Pourmand K, Sewell J, Shah B . What Makes a Good Endoscopic Teacher: A Qualitative Analysis. J Surg Educ. 2018; 75(5):1195-1199. DOI: 10.1016/j.jsurg.2018.02.016. View

19.

van Schaik S, Von Kohorn I, OSullivan P . Pediatric resident confidence in resuscitation skills relates to mock code experience. Clin Pediatr (Phila). 2008; 47(8):777-83. DOI: 10.1177/0009922808316992. View

20.

Villamaria F, Pliego J, Wehbe-Janek H, Coker N, Rajab M, Sibbitt S . Using simulation to orient code blue teams to a new hospital facility. Simul Healthc. 2008; 3(4):209-16. DOI: 10.1097/SIH.0b013e31818187f3. View