See One, Do One, Forget One: Early Skill Decay After Paracentesis Training

Overview

Journal J Gen Intern Med

Publisher Springer

Specialty General Medicine

Date 2020 Sep 24

PMID 32968968

Citations 3

Authors

Dana Sall

Eric J Warm

Benjamin Kinnear

Matthew Kelleher

Roman Jandarov

Jennifer OToole

Affiliations

Soon will be listed here.

Abstract

Introduction: Internal medicine residents perform paracentesis, but programs lack standard methods for assessing competence or maintenance of competence and instead rely on number of procedures completed. This study describes differences in resident competence in paracentesis over time.

Methods: From 2016 to 2017, internal medicine residents (n = 118) underwent paracentesis simulation training. Competence was assessed using the Paracentesis Competency Assessment Tool (PCAT), which combines a checklist, global scale, and entrustment score. The PCAT also delineates two categorical cut-point scores: the Minimum Passing Standard (MPS) and the Unsupervised Practice Standard (UPS). Residents were randomized to return to the simulation lab at 3 and 6 months (group A, n = 60) or only 6 months (group B, n = 58). At each session, faculty raters assessed resident performance. Data were analyzed to compare resident performance at each session compared with initial training scores, and performance between groups at 6 months.

Results: After initial training, all residents met the MPS. The number achieving UPS did not differ between groups: group A = 24 (40%), group B = 20 (34.5%), p = 0.67. When group A was retested at 3 months, performance on each PCAT component significantly declined, as did the proportion of residents meeting the MPS and UPS. At the 6-month test, residents in group A performed significantly better than residents in group B, with 52 (89.7%) and 20 (34.5%) achieving the MPS and UPS, respectively, in group A compared with 25 (46.3%) and 2 (3.70%) in group B (p < .001 for both comparison).

Discussion: Skill in paracentesis declines as early as 3 months after training. However, retraining may help interrupt skill decay. Only a small proportion of residents met the UPS 6 months after training. This suggests using the PCAT to objectively measure competence would reclassify residents from being permitted to perform paracentesis independently to needing further supervision.

Citing Articles

Does an instructional video as a stand-alone tool promote the acquisition of practical clinical skills? A randomised simulation research trial of skills acquisition and short-term retention.

Ott T, Demare T, Mohrke J, Silber S, Schwab J, Reuter L BMC Med Educ. 2024; 24(1):714.

PMID: 38956562 PMC: 11221112. DOI: 10.1186/s12909-024-05714-6.

The Impact of a Paracentesis Clinic on Internal Medicine Resident Procedural Competency.

Seth N, Tran P, Ghauri A, Sikka A, Metting A, Martinez G Fed Pract. 2024; 41(2):48-51.

PMID: 38835926 PMC: 11147432. DOI: 10.12788/fp.0449.

Cohort study of hospitalists' procedural skills: baseline competence and durability after simulation-based training.

Hale C, Crocker J, Vanka A, Ricotta D, McSparron J, Huang G BMJ Open. 2021; 11(8):e045600.

PMID: 34400443 PMC: 8370503. DOI: 10.1136/bmjopen-2020-045600.

References

Crofts J, Bartlett C, Ellis D, Hunt L, Fox R, Draycott T . Management of shoulder dystocia: skill retention 6 and 12 months after training. Obstet Gynecol. 2007; 110(5):1069-74. DOI: 10.1097/01.AOG.0000286779.41037.38. View

Mourad M, Kohlwes J, Maselli J, Auerbach A . Supervising the supervisors--procedural training and supervision in internal medicine residency. J Gen Intern Med. 2010; 25(4):351-6. PMC: 2842555. DOI: 10.1007/s11606-009-1226-z. View

Boutis K, Pecaric M, Carriere B, Stimec J, Willan A, Chan J . The effect of testing and feedback on the forgetting curves for radiograph interpretation skills. Med Teach. 2019; 41(7):756-764. DOI: 10.1080/0142159X.2019.1570098. View

Barsuk J, Feinglass J, Kozmic S, Hohmann S, Ganger D, Wayne D . Specialties performing paracentesis procedures at university hospitals: implications for training and certification. J Hosp Med. 2014; 9(3):162-8. DOI: 10.1002/jhm.2153. View

Huang G, Smith C, Gordon C, Feller-Kopman D, Davis R, Phillips R . Beyond the comfort zone: residents assess their comfort performing inpatient medical procedures. Am J Med. 2006; 119(1):71.e17-24. DOI: 10.1016/j.amjmed.2005.08.007. View

Yamamoto R, Clanton D, Willis R, Jonas R, Cestero R . Rapid decay of transthoracic echocardiography skills at 1 month: A prospective observational study. J Surg Educ. 2017; 75(2):503-509. DOI: 10.1016/j.jsurg.2017.07.011. View

Barsuk J, Cohen E, Caprio T, McGaghie W, Simuni T, Wayne D . Simulation-based education with mastery learning improves residents' lumbar puncture skills. Neurology. 2012; 79(2):132-7. PMC: 3390539. DOI: 10.1212/WNL.0b013e31825dd39d. View

Smith K, Gilcreast D, Pierce K . Evaluation of staff's retention of ACLS and BLS skills. Resuscitation. 2008; 78(1):59-65. DOI: 10.1016/j.resuscitation.2008.02.007. View

Bekele A, Wondimu S, Firdu N, Taye M, Tadesse A . Trends in Retention and Decay of Basic Surgical Skills: Evidence from Addis Ababa University, Ethiopia: A Prospective Case-Control Cohort Study. World J Surg. 2018; 43(1):9-15. DOI: 10.1007/s00268-018-4752-1. View

10.

Didwania A, McGaghie W, Cohen E, Butter J, Barsuk J, Wade L . Progress toward improving the quality of cardiac arrest medical team responses at an academic teaching hospital. J Grad Med Educ. 2012; 3(2):211-6. PMC: 3184920. DOI: 10.4300/JGME-D-10-00144.1. View

11.

Ericsson K . Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice. Acad Med. 2015; 90(11):1471-86. DOI: 10.1097/ACM.0000000000000939. View

12.

Barsuk J, Cohen E, Feinglass J, McGaghie W, Wayne D . Residents' Procedural Experience Does Not Ensure Competence: A Research Synthesis. J Grad Med Educ. 2017; 9(2):201-208. PMC: 5398145. DOI: 10.4300/JGME-D-16-00426.1. View

13.

Thakkar R, Wright S, Alguire P, Wigton R, Boonyasai R . Procedures performed by hospitalist and non-hospitalist general internists. J Gen Intern Med. 2010; 25(5):448-52. PMC: 2855006. DOI: 10.1007/s11606-010-1284-2. View

14.

Warm E, Mathis B, Held J, Pai S, Tolentino J, Ashbrook L . Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014; 29(8):1177-82. PMC: 4099463. DOI: 10.1007/s11606-014-2801-5. View

15.

Barsuk J, Cohen E, Nguyen D, Mitra D, OHara K, Okuda Y . Attending Physician Adherence to a 29-Component Central Venous Catheter Bundle Checklist During Simulated Procedures. Crit Care Med. 2016; 44(10):1871-81. DOI: 10.1097/CCM.0000000000001831. View

16.

Schuwirth L, Southgate L, Page G, Paget N, Lescop J, Lew S . When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Med Educ. 2002; 36(10):925-30. DOI: 10.1046/j.1365-2923.2002.01313.x. View

17.

Cecilio-Fernandes D, Cnossen F, Jaarsma D, Tio R . Avoiding Surgical Skill Decay: A Systematic Review on the Spacing of Training Sessions. J Surg Educ. 2017; 75(2):471-480. DOI: 10.1016/j.jsurg.2017.08.002. View

18.

Warm E, Held J, Hellmann M, Kelleher M, Kinnear B, Lee C . Entrusting Observable Practice Activities and Milestones Over the 36 Months of an Internal Medicine Residency. Acad Med. 2016; 91(10):1398-1405. DOI: 10.1097/ACM.0000000000001292. View

19.

Sawyer T, White M, Zaveri P, Chang T, Ades A, French H . Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine. Acad Med. 2015; 90(8):1025-33. DOI: 10.1097/ACM.0000000000000734. View

20.

Wayne D, Barsuk J, OLeary K, Fudala M, McGaghie W . Mastery learning of thoracentesis skills by internal medicine residents using simulation technology and deliberate practice. J Hosp Med. 2008; 3(1):48-54. DOI: 10.1002/jhm.268. View