Can Different Admissions to Medical School Predict Performance of Non-Technical Skill Performance in Simulated Clinical Settings?

Overview

Journal Healthcare (Basel)

Specialty Health Services

Date 2023 Jan 8

PMID 36611506

Authors

Parisa Moll-Khosrawi

Wolfgang Hampe

Leonie Schulte-Uentrop

Christian Zollner

Stefan Zimmermann

Thorben Huelmann

Affiliations

Soon will be listed here.

Abstract

Non-technical skills (NTS) in medical care are essential to ensure patient safety. Focussing on applicants' NTS during medical school admission could be a promising approach to ensure that future physicians master NTS at a high level. Next to pre-university educational attainment, many selection tests have been developed worldwide to facilitate and standardise the selection process of medical students. The predictive validity of these tests regarding NTS performance in clinical settings has not been investigated (yet). Therefore, we explored the predictive validities and prognosis of the Hamburg MMI (HAM-Int), HAM-Nat, PEA, and waiting as well as other quota (as example) designated by the Federal Armed Forces) for NTS performance in clinical emergency medicine training of medical students. During 2017 and 2020, = 729 second, third, and fourth year students were enrolled within the study. The mean age of participants was 26.68 years (SD 3.96) and 49% were female students. NTS of these students were assessed during simulation scenarios of emergency training with a validated rating tool. Students admitted via waiting quota and designated by the Armed Forces performed significantly better than students admitted by excellent PEA ( = 0.026). Non-EU students performed significantly inferior ( = 0.003). Our findings provide further insight to explain how and if admission to medical school could predict NTS performance of further physicians.

References

Ellis R, Brennan P, Scrimgeour D, Lee A, Cleland J . Performance at medical school selection correlates with success in Part A of the intercollegiate Membership of the Royal College of Surgeons (MRCS) examination. Postgrad Med J. 2021; 98(1161):e19. DOI: 10.1136/postgradmedj-2021-139748. View

Eva K, Reiter H, Rosenfeld J, Norman G . The ability of the multiple mini-interview to predict preclerkship performance in medical school. Acad Med. 2004; 79(10 Suppl):S40-2. DOI: 10.1097/00001888-200410001-00012. View

Tiffin P, Finn G, McLachlan J . Evaluating professionalism in medical undergraduates using selected response questions: findings from an item response modelling study. BMC Med Educ. 2011; 11:43. PMC: 3146946. DOI: 10.1186/1472-6920-11-43. View

Werwick K, Winkler-Stuck K, Robra B . From HAM-Nat to the "Physikum" - Analysis of the study success parameters before and after the introduction of a science test in the approval procedure. GMS J Med Educ. 2018; 35(3):Doc30. PMC: 6120148. DOI: 10.3205/zma001176. View

Knorr M, Hissbach J . Multiple mini-interviews: same concept, different approaches. Med Educ. 2014; 48(12):1157-75. DOI: 10.1111/medu.12535. View

Greif R, Bhanji F, Bigham B, Bray J, Breckwoldt J, Cheng A . Education, Implementation, and Teams: 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Circulation. 2020; 142(16_suppl_1):S222-S283. DOI: 10.1161/CIR.0000000000000896. View

Weinger M . Experience not equal expertise: can simulation be used to tell the difference?. Anesthesiology. 2007; 107(5):691-4. DOI: 10.1097/01.anes.0000287288.83609.c4. View

McCrae R . Seeking a Philosophical Basis for Trait Psychology. Psychol Rep. 2022; 127(6):2784-2811. DOI: 10.1177/00332941221132992. View

Paton L, McManus I, Cheung K, Smith D, Tiffin P . Can achievement at medical admission tests predict future performance in postgraduate clinical assessments? A UK-based national cohort study. BMJ Open. 2022; 12(2):e056129. PMC: 8830227. DOI: 10.1136/bmjopen-2021-056129. View

10.

Patterson F, Zibarras L, Ashworth V . Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100. Med Teach. 2015; 38(1):3-17. DOI: 10.3109/0142159X.2015.1072619. View

11.

Jerant A, Griffin E, Rainwater J, Henderson M, Sousa F, Bertakis K . Does applicant personality influence multiple mini-interview performance and medical school acceptance offers?. Acad Med. 2012; 87(9):1250-9. DOI: 10.1097/ACM.0b013e31826102ad. View

12.

Emery J, Bell J, Vidal Rodeiro C . The BioMedical Admissions Test for medical student selection: issues of fairness and bias. Med Teach. 2010; 33(1):62-71. DOI: 10.3109/0142159X.2010.528811. View

13.

Pau A, Jeevaratnam K, Chen Y, Fall A, Khoo C, Nadarajah V . The Multiple Mini-Interview (MMI) for student selection in health professions training - a systematic review. Med Teach. 2013; 35(12):1027-41. DOI: 10.3109/0142159X.2013.829912. View

14.

Knorr M, Meyer H, Sehner S, Hampe W, Zimmermann S . Exploring sociodemographic subgroup differences in multiple mini-interview (MMI) performance based on MMI station type and the implications for the predictive fairness of the Hamburg MMI. BMC Med Educ. 2019; 19(1):243. PMC: 6610801. DOI: 10.1186/s12909-019-1674-z. View

15.

Gawronski O, Thekkan K, Genna C, Egman S, Sansone V, Erba I . Instruments to evaluate non-technical skills during high fidelity simulation: A systematic review. Front Med (Lausanne). 2022; 9:986296. PMC: 9669714. DOI: 10.3389/fmed.2022.986296. View

16.

Knorr M, Schwibbe A, Ehrhardt M, Lackamp J, Zimmermann S, Hampe W . Validity evidence for the Hamburg multiple mini-interview. BMC Med Educ. 2018; 18(1):106. PMC: 5950198. DOI: 10.1186/s12909-018-1208-0. View

17.

Flowerdew L, Brown R, Vincent C, Woloshynowych M . Development and validation of a tool to assess emergency physicians' nontechnical skills. Ann Emerg Med. 2012; 59(5):376-385.e4. DOI: 10.1016/j.annemergmed.2011.11.022. View

18.

Moll-Khosrawi P, Kamphausen A, Hampe W, Schulte-Uentrop L, Zimmermann S, Kubitz J . Anaesthesiology students' Non-Technical skills: development and evaluation of a behavioural marker system for students (AS-NTS). BMC Med Educ. 2019; 19(1):205. PMC: 6567593. DOI: 10.1186/s12909-019-1609-8. View

19.

Hudson N, Fraley R . Volitional personality trait change: Can people choose to change their personality traits?. J Pers Soc Psychol. 2015; 109(3):490-507. DOI: 10.1037/pspp0000021. View

20.

Hissbach J, Feddersen L, Sehner S, Hampe W . Suitability of the HAM-Nat test and TMS module "basic medical-scientific understanding" for medical school selection. GMS Z Med Ausbild. 2012; 29(5):Doc72. PMC: 3525917. DOI: 10.3205/zma000842. View