The Reliability of the Wisconsin Card Sorting Test in Clinical Practice

Overview

Journal Assessment

Publisher Sage Publications

Specialties Psychiatry
Psychology

Date 2019 Aug 4

PMID 31375035

Citations 44

Authors

Bruno Kopp

Florian Lange

Alexander Steinke

Affiliations

Soon will be listed here.

Abstract

The Wisconsin Card Sorting Test (WCST) represents the gold standard for the neuropsychological assessment of executive function. However, very little is known about its reliability. In the current study, 146 neurological inpatients received the Modified WCST (M-WCST). Four basic measures (number of correct sorts, categories, perseverative errors, set-loss errors) and their composites were evaluated for split-half reliability. The reliability estimates of the number of correct sorts, categories, and perseverative errors fell into the desirable range ( ≥ .90). The study therefore disclosed sufficiently reliable M-WCST measures, fostering the application of this eminent psychological test to neuropsychological assessment. Our data also revealed that the M-WCST possesses substantially better psychometric properties than would be expected from previous studies of WCST test-retest reliabilities obtained from non-patient samples. Our study of split-half reliabilities from discretionary construed and from randomly built M-WCST splits exemplifies a novel approach to the psychometric foundation of neuropsychology.

Citing Articles

Predictors of subjective memory functioning in young adults.

Csabi E, Kovacs F, Volosin M BMC Psychiatry. 2025; 25(1):155.

PMID: 39972297 PMC: 11841223. DOI: 10.1186/s12888-025-06568-y.

Interactions between ABC gene polymorphisms and processing speed in predicting depression severity.

Jin M, Ji L, Ran M, Bi Y, Zhang H, Tao Y BMC Psychiatry. 2025; 25(1):102.

PMID: 39910465 PMC: 11800503. DOI: 10.1186/s12888-025-06507-x.

The future of neuropsychology is digital, theory-driven, and Bayesian: a paradigmatic study of cognitive flexibility.

Schmerwitz C, Kopp B Front Psychol. 2024; 15:1437192.

PMID: 39070581 PMC: 11276732. DOI: 10.3389/fpsyg.2024.1437192.

Performance of the Wisconsin Card Sorting Test in Oncopediatric Patients in an Oncology Unit in Cali, Colombia: A Cross-Sectional Observational Study.

Jimenez Urrego A, Santa V, Guerrero Gomez M, Guerrero Benitez A, Romo-Gonzalez T, Botero Carvajal A Children (Basel). 2024; 11(7).

PMID: 39062299 PMC: 11275006. DOI: 10.3390/children11070850.

Updating Prospective Self-Efficacy Beliefs About Cardiac Interoception in Anorexia Nervosa: An Experimental and Computational Study.

Saramandi A, Crucianelli L, Koukoutsakis A, Nistico V, Mavromara L, Goeta D Comput Psychiatr. 2024; 8(1):92-118.

PMID: 38948255 PMC: 11212784. DOI: 10.5334/cpsy.109.

References

Charter R . Sample size requirements for precise estimates of reliability, generalizability, and validity coefficients. J Clin Exp Neuropsychol. 1999; 21(4):559-66. DOI: 10.1076/jcen.21.4.559.889. View

Miller J, Ulrich R . Mental chronometry and individual differences: modeling reliabilities and correlations of reaction time means and effect sizes. Psychon Bull Rev. 2013; 20(5):819-58. DOI: 10.3758/s13423-013-0404-5. View

Kopp B, Maldonado N, Scheffels J, Hendel M, Lange F . A Meta-Analysis of Relationships between Measures of Wisconsin Card Sorting and Intelligence. Brain Sci. 2019; 9(12). PMC: 6956132. DOI: 10.3390/brainsci9120349. View

Spearman C . The proof and measurement of association between two things. By C. Spearman, 1904. Am J Psychol. 1987; 100(3-4):441-71. View

Grant D, BERG E . A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. J Exp Psychol. 1948; 38(4):404-11. DOI: 10.1037/h0059831. View

Lange F, Bruckner C, Knebel A, Seer C, Kopp B . Executive dysfunction in Parkinson's disease: A meta-analysis on the Wisconsin Card Sorting Test literature. Neurosci Biobehav Rev. 2018; 93:38-56. DOI: 10.1016/j.neubiorev.2018.06.014. View

Revelle W, Condon D . Reliability from α to ω: A tutorial. Psychol Assess. 2019; 31(12):1395-1411. DOI: 10.1037/pas0000754. View

Sanchez-Meca J, Lopez-Lopez J, Lopez-Pina J . Some recommended statistical analytic practices when reliability generalization studies are conducted. Br J Math Stat Psychol. 2012; 66(3):402-25. DOI: 10.1111/j.2044-8317.2012.02057.x. View

McManus I . The misinterpretation of the standard error of measurement in medical education: a primer on the problems, pitfalls and peculiarities of the three different standard errors of measurement. Med Teach. 2012; 34(7):569-76. DOI: 10.3109/0142159X.2012.670318. View

10.

Botella J, Suero M, Gambara H . Psychometric inferences from a meta-analysis of reliability and internal consistency coefficients. Psychol Methods. 2010; 15(4):386-97. DOI: 10.1037/a0019626. View

11.

Lineweaver T, Bond M, Thomas R, Salmon D . A normative study of Nelson's (1976) modified version of the Wisconsin Card Sorting Test in healthy older adults. Clin Neuropsychol. 2000; 13(3):328-47. DOI: 10.1076/clin.13.3.328.1745. View

12.

Rouder J, Haaf J . A psychometrics of individual differences in experimental tasks. Psychon Bull Rev. 2019; 26(2):452-467. DOI: 10.3758/s13423-018-1558-y. View

13.

Charter R . A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. J Gen Psychol. 2003; 130(3):290-304. DOI: 10.1080/00221300309601160. View

14.

Pauly M, Umlauft M, Unlu A . Resampling-Based Inference Methods for Comparing Two Coefficients Alpha. Psychometrika. 2018; 83(1):203-222. DOI: 10.1007/s11336-017-9601-x. View

15.

Hedge C, Powell G, Sumner P . The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behav Res Methods. 2017; 50(3):1166-1186. PMC: 5990556. DOI: 10.3758/s13428-017-0935-1. View

16.

Appelbaum M, Cooper H, Kline R, Mayo-Wilson E, Nezu A, Rao S . Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. Am Psychol. 2018; 73(1):3-25. DOI: 10.1037/amp0000191. View

17.

Demakis G . A meta-analytic review of the sensitivity of the Wisconsin Card Sorting Test to frontal and lateralized frontal brain damage. Neuropsychology. 2003; 17(2):255-64. DOI: 10.1037/0894-4105.17.2.255. View

18.

Cooper S, Gonthier C, Barch D, Braver T . The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT. Front Psychol. 2017; 8:1482. PMC: 5591582. DOI: 10.3389/fpsyg.2017.01482. View

19.

Hilsabeck R . Psychometrics and statistics: two pillars of neuropsychological practice. Clin Neuropsychol. 2017; 31(6-7):995-999. DOI: 10.1080/13854046.2017.1350752. View

20.

Rabin L, Barr W, Burton L . Assessment practices of clinical neuropsychologists in the United States and Canada: a survey of INS, NAN, and APA Division 40 members. Arch Clin Neuropsychol. 2004; 20(1):33-65. DOI: 10.1016/j.acn.2004.02.005. View