Validation of a Clinical Rotation Evaluation for Physician Assistant Students

Overview

Journal BMC Med Educ

Publisher Biomed Central

Specialty Medical Education

Date 2018 Jun 6

PMID 29866089

Authors

Ryan A Meverden

Jason H Szostek

Saswati Mahapatra

Cathy D Schleck

Jayawant N Mandrekar

Thomas J Beckman

Christopher M Wittich

Affiliations

Soon will be listed here.

Abstract

Background: We conducted a prospective validation study to develop a physician assistant (PA) clinical rotation evaluation (PACRE) instrument. The specific aims of this study were to 1) develop a tool to evaluate PA clinical rotations, and 2) explore associations between validated rotation evaluation scores and characteristics of the students and rotations.

Methods: The PACRE was administered to rotating PA students at our institution in 2016. Factor analysis, internal consistency reliability, and associations between PACRE scores and student or rotation characteristics were determined.

Results: Of 206 PACRE instruments sent, 124 were returned (60.2% response). Factor analysis supported a unidimensional model with a mean (SD) score of 4.31 (0.57) on a 5-point scale. Internal consistency reliability was excellent (Cronbach α=0.95). PACRE scores were associated with students' gender (P = .01) and rotation specialty (P = .006) and correlated with students' perception of being prepared (r = 0.32; P < .001) and value of the rotation (r = 0.57; P < .001).

Conclusions: This is the first validated instrument to evaluate PA rotation experiences. Application of the PACRE questionnaire could inform rotation directors about ways to improve clinical experiences. The findings of this study suggest that PA students must be adequately prepared to have a successful experience on their rotations. PA programs should consider offering transition courses like those offered in many medical schools to prepare their students for clinical experiences. Future research should explore whether additional rotation characteristics and educational outcomes are associated with PACRE scores.

References

Hunter A, Desai S, Harrison R, Chan B . Medical student evaluation of the quality of hospitalist and nonhospitalist teaching faculty on inpatient medicine rotations. Acad Med. 2003; 79(1):78-82. DOI: 10.1097/00001888-200401000-00017. View

Hudak N, Enking P, Gorney C, Gonzalez-Colaso R . Tales from the trenches: physician assistants' perspectives about precepting students. J Physician Assist Educ. 2014; 25(1):12-9. DOI: 10.1097/01367895-201425010-00002. View

Post J, Wittich C, Thomas K, Dupras D, Halvorsen A, Mandrekar J . Rating the Quality of Entrustable Professional Activities: Content Validation and Associations with the Clinical Context. J Gen Intern Med. 2016; 31(5):518-23. PMC: 4835372. DOI: 10.1007/s11606-016-3611-8. View

Litzelman D, Westmoreland G, Skeff K, Stratos G . Factorial validation of an educational framework using residents' evaluations of clinician-educators. Acad Med. 1999; 74(10 Suppl):S25-7. DOI: 10.1097/00001888-199910000-00030. View

Dolmans D, Wolfhagen I, Essed G, Scherpbier A, van der Vleuten C . The impacts of supervision, patient mix, and numbers of students on the effectiveness of clinical rotations. Acad Med. 2002; 77(4):332-5. DOI: 10.1097/00001888-200204000-00016. View

Rogers J, Lautar C, Dunn L . Allied health students' perceptions of effective clinical instruction. Health Care Manag (Frederick). 2010; 29(1):63-7. DOI: 10.1097/HCM.0b013e3181cca311. View

Iblher P, Zupanic M, Hartel C, Heinze H, Schmucker P, Fischer M . The Questionnaire "SFDP26-German": a reliable tool for evaluation of clinical teaching?. GMS Z Med Ausbild. 2011; 28(2):Doc30. PMC: 3149471. DOI: 10.3205/zma000742. View

Torre D, Sebastian J, Simpson D . Learning activities and high-quality teaching: perceptions of third-year IM clerkship students. Acad Med. 2003; 78(8):812-4. DOI: 10.1097/00001888-200308000-00015. View

Porter S . Just-released clerkship study: growing shortage of clinical training sites challenges medical schools. Ann Fam Med. 2014; 12(5):484-6. PMC: 4157994. DOI: 10.1370/afm.1709. View

10.

Lewisson N, Hellgren L, Johansson J . Quality improvement in clinical teaching through student evaluations of rotations and feedback to departments. Med Teach. 2013; 35(10):820-5. DOI: 10.3109/0142159X.2013.802302. View

11.

Wieland M, Halvorsen A, Chaudhry R, Reed D, McDonald F, Thomas K . An evaluation of internal medicine residency continuity clinic redesign to a 50/50 outpatient-inpatient model. J Gen Intern Med. 2013; 28(8):1014-9. PMC: 3710381. DOI: 10.1007/s11606-012-2312-1. View

12.

Dyrbye L, Thomas M, Harper W, Massie Jr F, Power D, Eacker A . The learning environment and medical student burnout: a multicentre study. Med Educ. 2009; 43(3):274-82. DOI: 10.1111/j.1365-2923.2008.03282.x. View

13.

Litzelman D, Stratos G, Marriott D, Skeff K . Factorial validation of a widely disseminated educational framework for evaluating clinical teachers. Acad Med. 1998; 73(6):688-95. DOI: 10.1097/00001888-199806000-00016. View

14.

Cook D, Beckman T . Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006; 119(2):166.e7-16. DOI: 10.1016/j.amjmed.2005.10.036. View

15.

Kirton O, Antonetti M, Morejon O, Dobkin E, Angelica M, Reilly P . Measuring service-specific performance and educational value within a general surgery residency: the power of a prospective, anonymous, Web-based rotation evaluation system in the optimization of resident satisfaction. Surgery. 2001; 130(2):289-95. DOI: 10.1067/msy.2001.116031. View

16.

Owolabi M . Development and psychometric characteristics of a new domain of the stanford faculty development program instrument. J Contin Educ Health Prof. 2014; 34(1):13-24. DOI: 10.1002/chp.21213. View

17.

Jarski R, Kulig K, Olson R . Allied health perceptions of effective clinical instruction. J Allied Health. 1989; 18(5):469-78. View

18.

Remmen R, Denekens J, Scherpbier A, Hermann I, van der Vleuten C, Royen P . An evaluation study of the didactic quality of clerkships. Med Educ. 2000; 34(6):460-4. DOI: 10.1046/j.1365-2923.2000.00570.x. View

19.

Sutkin G, Wagner E, Harris I, Schiffer R . What makes a good clinical teacher in medicine? A review of the literature. Acad Med. 2008; 83(5):452-66. DOI: 10.1097/ACM.0b013e31816bee61. View

20.

Winter R, Jones R . Clerkship evaluation by students: a standardized electronic mechanism. Acad Med. 1997; 72(5):418. DOI: 10.1097/00001888-199705000-00041. View