The Effect on Reliability of Adding a Separate Written Assessment Component to an Objective Structured Clinical Examination
Overview
Affiliations
Purpose: To determine the effect on test reliability when a separate written assessment component is added to an objective structured clinical examination (OSCE).
Method: Volunteers (n=38) from Maastricht Medical School were recruited to take a skills-related knowledge test in addition to their regular end-of-year OSCE. The OSCE scores of these volunteers did not differ from those of the other students of their class. Multivariate generalizability theory was used to investigate the combined reliability of the two test formats as well as their respective contributions to overall reliability.
Results: Combining the two formats has an added value. The loss of reliability due to the use of fewer stations in the OSCE can be fully compensated by lengthening the written test component.
Conclusion: From the perspective of test reliability, it is possible to economize on the resources needed for performance-based assessment by adding a separate written test component.
Vishwakarma K, Sharma M, Singh Matreja P, Giri V Indian J Pharmacol. 2016; 48(Suppl 1):S47-S51.
PMID: 28031608 PMC: 5178055. DOI: 10.4103/0253-7613.193317.
Mangold K, Jeffers J, Burns R, Trainor J, Unti S, Eppich W J Grad Med Educ. 2015; 7(3):470-4.
PMID: 26457159 PMC: 4597964. DOI: 10.4300/JGME-D-14-00777.1.
Wagner-Menghin M, Preusche I, Schmidts M Wien Med Wochenschr. 2015; 165(5-6):91-7.
PMID: 25724462 DOI: 10.1007/s10354-015-0348-7.
Roberts C, Clark T, Burgess A, Frommer M, Grant M, Mossman K BMC Med Educ. 2014; 14:169.
PMID: 25123968 PMC: 4136634. DOI: 10.1186/1472-6920-14-169.
An objective structured clinical examination to assess problem-based learning.
Salinitri F, OConnell M, Garwood C, Tutag Lehr V, Abdallah K Am J Pharm Educ. 2012; 76(3):44.
PMID: 22544961 PMC: 3327242. DOI: 10.5688/ajpe76344.