Workplace-Based Assessment of Internal Medicine Resident Diagnostic Accuracy

Overview

Journal J Grad Med Educ

Date 2015 Aug 18

PMID 26279781

Citations 2

Authors

Michael D Jain

George A Tomlinson

Danica Lam

Jessica Liu

Deepti Damaraju

Allan S Detsky

Luke A Devine

Affiliations

Soon will be listed here.

Abstract

Background: Making an accurate diagnosis is a core skill residents must develop. Assessments of this skill and decisions to grant residents clinical independence often are based on global impressions. A workplace-based assessment of diagnostic accuracy could be a useful part of a competency-based assessment program and could inform decisions about granting residents independence.

Innovation: We developed a method for measuring diagnostic accuracy that was integrated into the workflow of internal medicine residents and attending physicians.

Methods: Four senior medical residents and 6 attending physicians working in the internal medicine clinical teaching unit of a tertiary hospital participated in this study. To determine their diagnostic accuracy, residents documented a leading diagnosis for each patient they evaluated in the emergency department. After reviewing each case with the resident and after examining the patient, the resident's attending physician documented the diagnosis. Discharge diagnosis was determined by retrospective chart review to allow determination of resident and attending physician diagnostic accuracy. Data were collected for 240 consecutive patients referred for a medicine consultation.

Results: Resident diagnostic accuracy was 66% (95% CI 60-72), whereas attending physician accuracy was significantly higher at 79% (95% CI 74-84, P < .001). By logistic regression, the accuracy of the attending physician was found to be influenced by the accuracy of the resident. Participants felt this process motivated them to improve their clinical reasoning.

Conclusions: Measuring resident diagnostic accuracy provides information that could be used in a competency-based assessment program to provide feedback and motivation to stimulate performance improvement.

Citing Articles

The Diagnostic Process for the Evaluation of Acute Abdominal Pain by Resident Trainees in Japan: A Cross-sectional Study.

Amari K, Fukumori N, Anzai K, Yamashita S Intern Med. 2020; 59(10):1257-1265.

PMID: 32418953 PMC: 7303460. DOI: 10.2169/internalmedicine.3526-19.

Using Chart Review and Chart-Stimulated Recall for Resident Assessment.

Philibert I J Grad Med Educ. 2018; 10(1):95-96.

PMID: 29467981 PMC: 5821017. DOI: 10.4300/JGME-D-17-01010.1.

References

Kennedy T, Regehr G, Baker G, Lingard L . Progressive independence in clinical training: a tradition worth defending?. Acad Med. 2005; 80(10 Suppl):S106-11. DOI: 10.1097/00001888-200510001-00028. View

Mylopoulos M, Lohfeld L, Norman G, Dhaliwal G, Eva K . Renowned physicians' perceptions of expert diagnostic practice. Acad Med. 2012; 87(10):1413-7. DOI: 10.1097/ACM.0b013e31826735fc. View

Croskerry P . Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002; 9(11):1184-204. DOI: 10.1111/j.1553-2712.2002.tb01574.x. View

Ruchman R, Jaeger J, Wiggins 3rd E, Seinfeld S, Thakral V, Bolla S . Preliminary radiology resident interpretations versus final attending radiologist interpretations and the impact on patient care in a community hospital. AJR Am J Roentgenol. 2007; 189(3):523-6. DOI: 10.2214/AJR.07.2307. View

Kharbanda A, Fishman S, Bachur R . Comparison of pediatric emergency physicians' and surgeons' evaluation and diagnosis of appendicitis. Acad Emerg Med. 2008; 15(2):119-25. DOI: 10.1111/j.1553-2712.2008.00029.x. View

Moeller J, Kurniawan J, Gubitz G, Ross J, Bhan V . Diagnostic accuracy of neurological problems in the emergency department. Can J Neurol Sci. 2008; 35(3):335-41. DOI: 10.1017/s0317167100008921. View

Christmas C, Kravet S, Durso S, Wright S . Clinical excellence in academia: perspectives from masterful academic clinicians. Mayo Clin Proc. 2008; 83(9):989-94. DOI: 10.4065/83.9.989. View

Jones R, Panda M, Desbiens N . Internal medicine residents do not accurately assess their medical knowledge. Adv Health Sci Educ Theory Pract. 2007; 13(4):463-8. DOI: 10.1007/s10459-007-9058-2. View

Sterkenburg A, Barach P, Kalkman C, Gielen M, Ten Cate O . When do supervising physicians decide to entrust residents with unsupervised tasks?. Acad Med. 2010; 85(9):1408-17. DOI: 10.1097/ACM.0b013e3181eab0ec. View

10.

Flink C, Mueller J, Kiproff P . Impact of resident call eligibility on major discrepancy rate. Acad Radiol. 2010; 17(10):1299-301. DOI: 10.1016/j.acra.2010.05.018. View

11.

Jo Y, Kim K, Rhee J, Kim T, Lee J, Kang S . The accuracy of emergency medicine and surgical residents in the diagnosis of acute appendicitis. Am J Emerg Med. 2010; 28(7):766-70. DOI: 10.1016/j.ajem.2009.03.017. View

12.

van der Vleuten C, Schuwirth L, Scheele F, Driessen E, Hodges B . The assessment of professional competence: building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 2010; 24(6):703-19. DOI: 10.1016/j.bpobgyn.2010.04.001. View

13.

Stroud L, Herold J, Tomlinson G, Cavalcanti R . Who you know or what you know? Effect of examiner familiarity with residents on OSCE scores. Acad Med. 2011; 86(10 Suppl):S8-11. DOI: 10.1097/ACM.0b013e31822a729d. View

14.

Detsky A . What patients really want from health care. JAMA. 2011; 306(22):2500-1. DOI: 10.1001/jama.2011.1819. View

15.

Ziegelstein R, Fiebach N . "The mirror" and "the village": a new method for teaching practice-based learning and improvement and systems-based practice. Acad Med. 2003; 79(1):83-8. DOI: 10.1097/00001888-200401000-00018. View