A Delphi Study to Construct a CanMEDS Competence Based Inventory Applicable for Workplace Assessment

Overview

Journal BMC Med Educ

Publisher Biomed Central

Specialty Medical Education

Date 2012 Sep 15

PMID 22973829

Citations 16

Authors

Nele R M Michels

Joke Denekens

Erik W Driessen

Luc F Van Gaal

Leo L Bossaert

Benedicte Y De Winter

Affiliations

Soon will be listed here.

Abstract

Background: During workplace based learning students develop professional competences and an appropriate performance. To gain insight in the learning process and to evaluate competences and performance, assessment tools are essential and need to be of good quality. We aimed to construct a competence inventory applicable as an instrument to measure the content validity of workplace based assessment tools, such as portfolio.

Methods: A Delphi study was carried out based on the CanMEDS Roles Framework. In three rounds, experts (N = 25-30) were invited to score the key competences per CanMEDS role on relevance (6-point Likert-scale), and to comment on the content and formulation bearing in mind its use in workplace based assessment. A descriptive analysis of relevances and comments was performed.

Results: Although all competences were scored as relevant, many comments pointed at a lack of concrete, transparent and applicable descriptions of the key competences for the purpose of assessment. Therefore, the CanMEDS roles were reformulated in this Delphi procedure as concrete learning outcomes, observable and suitable for workplace based assessment.

Conclusions: A competence based inventory, ready for validating workplace based assessment tools, was constructed using a Delphi procedure and based on a clarification and concretisation of the CanMEDS roles.

Citing Articles

How can peer teaching influence the development of medical students? a descriptive, longitudinal interview study.

Avonts M, Bombeke K, Michels N, Vanderveken O, De Winter B BMC Med Educ. 2023; 23(1):861.

PMID: 37957668 PMC: 10644508. DOI: 10.1186/s12909-023-04801-4.

Development of individual competencies and team performance in interprofessional ward rounds: results of a study with multimodal observations at the Heidelberg Interprofessional Training Ward.

Mitzkat A, Mink J, Arnold C, Mahler C, Mihaljevic A, Moltner A Front Med (Lausanne). 2023; 10:1241557.

PMID: 37828945 PMC: 10566636. DOI: 10.3389/fmed.2023.1241557.

When theory beats practice: the implementation of competency-based education at healthcare workplaces : Focus group interviews with students, mentors, and educators of six healthcare disciplines.

Janssens O, Embo M, Valcke M, Haerens L BMC Med Educ. 2023; 23(1):484.

PMID: 37386406 PMC: 10308607. DOI: 10.1186/s12909-023-04446-3.

Fitness-for-purpose of the CanMEDS competencies for workplace-based assessment in General Practitioner's Training: a Delphi study.

Andreou V, Peters S, Eggermont J, Embo M, Michels N, Schoenmakers B BMC Med Educ. 2023; 23(1):204.

PMID: 37005633 PMC: 10067520. DOI: 10.1186/s12909-023-04207-2.

Health Service Management and Patient Safety in Primary Care during the COVID-19 Pandemic in Kosovo.

Bojaj G, Tahirbegolli B, Beqiri P, Alloqi Tahirbegolli I, Van Poel E, Willems S Int J Environ Res Public Health. 2023; 20(4).

PMID: 36834461 PMC: 9965489. DOI: 10.3390/ijerph20043768.

References

Snadden D, Thomas M . Portfolio learning in general practice vocational training--does it work?. Med Educ. 1998; 32(4):401-6. DOI: 10.1046/j.1365-2923.1998.00245.x. View

Tochel C, Haig A, Hesketh A, Cadzow A, Beggs K, Colthart I . The effectiveness of portfolios for post-graduate assessment and education: BEME Guide No 12. Med Teach. 2009; 31(4):299-318. DOI: 10.1080/01421590902883056. View

. Portfolio-based learning in general practice. Report of a working group on higher professional education. Occas Pap R Coll Gen Pract. 1993; (63):1-22. PMC: 2560964. View

Michels N, Driessen E, Muijtjens A, Van Gaal L, Bossaert L, De Winter B . Portfolio assessment during medical internships: How to obtain a reliable and feasible assessment procedure?. Educ Health (Abingdon). 2009; 22(3):313. View

Crebbin W . What do you mean by "satisfactory"?. Ann Acad Med Singap. 2005; 34(8):473-7. View

Driessen E, van der Vleuten C, Schuwirth L, van Tartwijk J, Vermunt J . The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study. Med Educ. 2005; 39(2):214-20. DOI: 10.1111/j.1365-2929.2004.02059.x. View

Lurie S, Mooney C, Lyness J . Measurement of the general competencies of the accreditation council for graduate medical education: a systematic review. Acad Med. 2009; 84(3):301-9. DOI: 10.1097/ACM.0b013e3181971f08. View

Huddle T, Heudebert G . Taking apart the art: the risk of anatomizing clinical competence. Acad Med. 2007; 82(6):536-41. DOI: 10.1097/ACM.0b013e3180555935. View

Epstein R . Assessment in medical education. N Engl J Med. 2007; 356(4):387-96. DOI: 10.1056/NEJMra054784. View

10.

Jarvis R, OSullivan P, McClain T, Clardy J . Can one portfolio measure the six ACGME general competencies?. Acad Psychiatry. 2004; 28(3):190-6. DOI: 10.1176/appi.ap.28.3.190. View

11.

Norcini J . Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005; 39(9):880-9. DOI: 10.1111/j.1365-2929.2005.02182.x. View

12.

Driessen E, van Tartwijk J, van der Vleuten C, Wass V . Portfolios in medical education: why do they meet with mixed success? A systematic review. Med Educ. 2007; 41(12):1224-33. DOI: 10.1111/j.1365-2923.2007.02944.x. View

13.

Swing S . The ACGME outcome project: retrospective and prospective. Med Teach. 2008; 29(7):648-54. DOI: 10.1080/01421590701392903. View

14.

Schuwirth L, Southgate L, Page G, Paget N, Lescop J, Lew S . When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Med Educ. 2002; 36(10):925-30. DOI: 10.1046/j.1365-2923.2002.01313.x. View

15.

Buckley S, Coleman J, Davison I, Khan K, Zamora J, Malick S . The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2009; 31(4):282-98. DOI: 10.1080/01421590902889897. View

16.

Fastre G, van der Klink M, van Merrienboer J . The effects of performance-based assessment criteria on student performance and self-assessment skills. Adv Health Sci Educ Theory Pract. 2010; 15(4):517-32. PMC: 2964459. DOI: 10.1007/s10459-009-9215-x. View

17.

Schuwirth L, van der Vleuten C . Merging views on assessment. Med Educ. 2004; 38(12):1208-10. DOI: 10.1111/j.1365-2929.2004.02055.x. View

18.

Rethans J, Norcini J, Blackmore D, Jolly B, LaDuca T, Lew S . The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002; 36(10):901-9. DOI: 10.1046/j.1365-2923.2002.01316.x. View

19.

Frank J, Danoff D . The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2008; 29(7):642-7. DOI: 10.1080/01421590701746983. View

20.

. CanMEDS 2000: Extract from the CanMEDS 2000 Project Societal Needs Working Group Report. Med Teach. 2011; 22(6):549-54. DOI: 10.1080/01421590050175505. View