Do Physicians Remember Cases? Implications for Longitudinal Designs in Medical Research and Competency Assessment

Overview

Journal Res Methods Med Health Sci

Date 2025 Feb 3

PMID 39896337

Authors

Tad T Brunye

Catherine E Konold

Jason Wang

Kathleen F Kerr

Trafton Drew

Hannah Shucard

Kim Soroka

Donald L Weaver

Joann G Elmore

Affiliations

Soon will be listed here.

Abstract

Background: In pathology and other specialties of diagnostic medicine, longitudinal studies and competency assessments often involve physicians interpreting the same images multiple times. In these designs, a washout period is used to reduce the chances that later interpretations are influenced by prior exposure.

Objective/s: The present study examines whether a washout period between 9-39 months is sufficient to prevent three effects of prior exposure when pathologists review digital breast tissue biopsies and render diagnostic decisions: faster case review durations, higher confidence, and lower perceived difficulty.

Methods: In a longitudinal breast pathology study, 48 resident pathologists reviewed a mix of five novel and five repeated digital whole slide images during Phase 2, occurring 9-39 months after an initial Phase 1 review. Importantly, cases that were repeated for some participants in Phase 2 were novel for other participants in Phase 2. We statistically tested for differences in participants' case review duration, self-reported confidence, and self-reported difficulty in Phase 2 based on whether the case was novel or repeated.

Results: No statistically significant difference in review time, confidence, or difficulty as a function of whether the case was repeated or novel in a Phase 2 review occurring 9-39 months after initial viewing; this same result was found in a subset of participants with a shorter (9-14-month) washout.

Conclusion: These results provide evidence to support the efficacy of at least a 9-month washout period in the design of longitudinal medical imaging and informatics studies to ensure no detectable effect of initial exposure on participant's subsequent case review.

References

Folberg R, Antonioli D, Alexander C . Competency-based residency training in pathology: challenges and opportunities. Hum Pathol. 2002; 33(1):3-6. DOI: 10.1053/hupa.2002.30226. View

Wolfe J . Visual memory: what do you know about what you saw?. Curr Biol. 1998; 8(9):R303-4. DOI: 10.1016/s0960-9822(98)70192-7. View

Hojat M, Paskin D, Callahan C, Nasca T, Louis D, Veloski J . Components of postgraduate competence: analyses of thirty years of longitudinal data. Med Educ. 2007; 41(10):982-9. DOI: 10.1111/j.1365-2923.2007.02841.x. View

Meltzer J, Postman-Caucheteux W, McArdle J, Braun A . Strategies for longitudinal neuroimaging studies of overt language production. Neuroimage. 2009; 47(2):745-55. PMC: 2700210. DOI: 10.1016/j.neuroimage.2009.04.089. View

Drew T, Lavelle M, Kerr K, Shucard H, Brunye T, Weaver D . More scanning, but not zooming, is associated with diagnostic accuracy in evaluating digital breast pathology slides. J Vis. 2021; 21(11):7. PMC: 8525842. DOI: 10.1167/jov.21.11.7. View

Evans K, Cohen M, Tambouret R, Horowitz T, Kreindel E, Wolfe J . Does visual expertise improve visual recognition memory?. Atten Percept Psychophys. 2011; 73(1):30-5. PMC: 3140200. DOI: 10.3758/s13414-010-0022-5. View

Evans A, Brown R, Bui M, Chlipala E, Lacchetti C, Milner D . Validating Whole Slide Imaging Systems for Diagnostic Purposes in Pathology. Arch Pathol Lab Med. 2021; 146(4):440-450. DOI: 10.5858/arpa.2020-0723-CP. View

Larzabal C, Tramoni E, Muratot S, Thorpe S, Barbeau E . Extremely long-term memory and familiarity after 12 years. Cognition. 2017; 170:254-262. PMC: 5730537. DOI: 10.1016/j.cognition.2017.10.009. View

Brunye T, Mercan E, Weaver D, Elmore J . Accuracy is in the eyes of the pathologist: The visual interpretive process and diagnostic accuracy with digital whole slide images. J Biomed Inform. 2017; 66:171-179. PMC: 5316368. DOI: 10.1016/j.jbi.2017.01.004. View

10.

Brunye T, Carney P, Allison K, Shapiro L, Weaver D, Elmore J . Eye movements as an index of pathologist visual expertise: a pilot study. PLoS One. 2014; 9(8):e103447. PMC: 4118873. DOI: 10.1371/journal.pone.0103447. View

11.

McKenna B . The American Society for Clinical Pathology resident in-service examination: does resident performance provide insight into the effectiveness of clinical pathology education?. Clin Lab Med. 2007; 27(2):283-91. DOI: 10.1016/j.cll.2007.03.005. View

12.

Krupinski E, Graham A, Weinstein R . Characterizing the development of visual search expertise in pathology residents viewing whole slide images. Hum Pathol. 2012; 44(3):357-64. DOI: 10.1016/j.humpath.2012.05.024. View

13.

Hassell L, Fung K, Chaser B . Digital slides and ACGME resident competencies in anatomic pathology: An altered paradigm for acquisition and assessment. J Pathol Inform. 2011; 2:27. PMC: 3132992. DOI: 10.4103/2153-3539.82052. View

14.

Schill H, Wolfe J, Brady T . Relationships between expertise and distinctiveness: Abnormal medical images lead to enhanced memory performance only in experts. Mem Cognit. 2021; 49(6):1067-1081. DOI: 10.3758/s13421-021-01160-7. View

15.

Schacter D . Priming and multiple memory systems: perceptual mechanisms of implicit memory. J Cogn Neurosci. 2013; 4(3):244-56. DOI: 10.1162/jocn.1992.4.3.244. View

16.

Schott B, Henson R, Richardson-Klavehn A, Becker C, Thoma V, Heinze H . Redefining implicit and explicit memory: the functional neuroanatomy of priming, remembering, and control of retrieval. Proc Natl Acad Sci U S A. 2005; 102(4):1257-62. PMC: 545864. DOI: 10.1073/pnas.0409070102. View

17.

Onega T, Weaver D, Frederick P, Allison K, Tosteson A, Carney P . The diagnostic challenge of low-grade ductal carcinoma in situ. Eur J Cancer. 2017; 80:39-47. PMC: 5562412. DOI: 10.1016/j.ejca.2017.04.013. View

18.

Silber C, Nasca T, Paskin D, Eiger G, Robeson M, Veloski J . Do global rating forms enable program directors to assess the ACGME competencies?. Acad Med. 2004; 79(6):549-56. DOI: 10.1097/00001888-200406000-00010. View

19.

Campbell W, Talmon G, Foster K, Baker J, Smith L, Hinrichs S . Visual memory effects on intraoperator study design: determining a minimum time gap between case reviews to reduce recall bias. Am J Clin Pathol. 2015; 143(3):412-8. DOI: 10.1309/AJCPUC3TYMS3QOBM. View

20.

Caruana E, Roman M, Hernandez-Sanchez J, Solli P . Longitudinal studies. J Thorac Dis. 2015; 7(11):E537-40. PMC: 4669300. DOI: 10.3978/j.issn.2072-1439.2015.10.63. View