Validation of Korean Version of the Oxford Cognitive Screen (K-OCS), a Post Stroke-Specific Cognitive Screening Tool

Overview

Journal Ann Rehabil Med

Specialty Rehabilitation Medicine

Date 2025 Feb 12

PMID 39939896

Authors

Eunyoung Cho

Sungwon Choi

Nele Demeyere

Rina Kim

Ikhyun Lim

MinYoung Kim

Affiliations

Soon will be listed here.

Abstract

Objective: To establish and evaluate the validity of the recently developed Korean version of the Oxford Cognitive Screen (K-OCS), this study verified its reliability, validity, and diagnostic accuracy.

Methods: Between November 2021 and December 2023, we recruited 72 patients with stroke from our hospital who agreed to participate in the study. The patients were repeatedly tested using K-OCS by the same or different assessors to estimate inter- and intra-rater reliability. To demonstrate the validity and usability of K-OCS, the test results of screening tools currently used in clinical practice, including the Korean-Mini Mental State Examination and the Korean version of the Montreal Cognitive Assessment, were used in comparison analyses.

Results: The subtests of K-OCS demonstrated excellent inter-rater reliability (intra-class correlation coefficient [ICC]=0.914-0.998) and test-retest reliability (ICC=0.913-0.994). We found moderate-to-strong correlations for convergent validity for the subsets (r=0.378- 0.979, p<0.01), and low-to-moderate discriminant validity correlations. The optimal cut-offs estimated for the subtests of the K-OCS showed a good-to-high range of specificity (94.8%- 100%). The positive predictive value was 58.2%-100% and negative predictive value was 65.6%-98.4%. Sensitivity was estimated at 25.6%-86.9%.

Conclusion: The results of this study indicate that K-OCS is a reliable and valid tool for screening cognitive impairment in patients post-stroke.

References

Mancuso M, Demeyere N, Abbruzzese L, Damora A, Varalta V, Pirrotta F . Using the Oxford Cognitive Screen to Detect Cognitive Impairment in Stroke Patients: A Comparison with the Mini-Mental State Examination. Front Neurol. 2018; 9:101. PMC: 5836594. DOI: 10.3389/fneur.2018.00101. View

Koo T, Li M . A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016; 15(2):155-63. PMC: 4913118. DOI: 10.1016/j.jcm.2016.02.012. View

Sanctuary C, Hewitt L, Demeyere N, Kankkunen K, Oxenham D, Simpson D . The Oxford Cognitive Screen for use with Australian people after stroke (OCS-AU): The adaptation process and determining cut scores for cognitive impairment using a cross-sectional normative study. Aust Occup Ther J. 2022; 70(1):73-85. PMC: 10087605. DOI: 10.1111/1440-1630.12838. View

Bickerton W, Riddoch M, Samson D, Bahrami Balani A, Mistry B, Humphreys G . Systematic assessment of apraxia and functional predictions from the Birmingham Cognitive Screen. J Neurol Neurosurg Psychiatry. 2012; 83(5):513-21. DOI: 10.1136/jnnp-2011-300968. View

Pendlebury S, Rothwell P . Incidence and prevalence of dementia associated with transient ischaemic attack and stroke: analysis of the population-based Oxford Vascular Study. Lancet Neurol. 2019; 18(3):248-258. PMC: 6390174. DOI: 10.1016/S1474-4422(18)30442-3. View

Demeyere N, Riddoch M, Slavkova E, Bickerton W, Humphreys G . The Oxford Cognitive Screen (OCS): validation of a stroke-specific short cognitive screening tool. Psychol Assess. 2015; 27(3):883-94. DOI: 10.1037/pas0000082. View

Cramer S, Richards L, Bernhardt J, Duncan P . Cognitive Deficits After Stroke. Stroke. 2022; 54(1):5-9. DOI: 10.1161/STROKEAHA.122.041775. View

Wilson S, Eriksson D, Brandt T, Schneck S, Lucanie J, Burchfield A . Patterns of Recovery From Aphasia in the First 2 Weeks After Stroke. J Speech Lang Hear Res. 2019; 62(3):723-732. PMC: 6802900. DOI: 10.1044/2018_JSLHR-L-18-0254. View

Nasreddine Z, Phillips N, Bedirian V, Charbonneau S, Whitehead V, Collin I . The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005; 53(4):695-9. DOI: 10.1111/j.1532-5415.2005.53221.x. View

10.

Oh M, Yu K, Lee J, Jung S, Ko I, Shin J . Validity and reliability of a korean version of the national institutes of health stroke scale. J Clin Neurol. 2012; 8(3):177-83. PMC: 3469797. DOI: 10.3988/jcn.2012.8.3.177. View

11.

Akobeng A . Understanding diagnostic tests 1: sensitivity, specificity and predictive values. Acta Paediatr. 2007; 96(3):338-41. DOI: 10.1111/j.1651-2227.2006.00180.x. View

12.

Robotham R, Riis J, Demeyere N . A Danish version of the Oxford cognitive screen: a stroke-specific screening test as an alternative to the MoCA. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2019; 27(1):52-65. DOI: 10.1080/13825585.2019.1577352. View

13.

Mancuso M, Varalta V, Sardella L, Capitani D, Zoccolotti P, Antonucci G . Italian normative data for a stroke specific cognitive screening tool: the Oxford Cognitive Screen (OCS). Neurol Sci. 2016; 37(10):1713-21. DOI: 10.1007/s10072-016-2650-6. View

14.

El Husseini N, Katzan I, Rost N, Blake M, Byun E, Pendlebury S . Cognitive Impairment After Ischemic and Hemorrhagic Stroke: A Scientific Statement From the American Heart Association/American Stroke Association. Stroke. 2023; 54(6):e272-e291. DOI: 10.1161/STR.0000000000000430. View

15.

Folstein M, Folstein S, McHugh P . "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975; 12(3):189-98. DOI: 10.1016/0022-3956(75)90026-6. View

16.

Bormann T, Kaller C, Kulyk C, Demeyere N, Weiller C . The German version of the Oxford Cognitive Screen (D-OCS): Normative data and validation in acute stroke and a mixed neurological sample. J Neuropsychol. 2024; 18(3):377-390. DOI: 10.1111/jnp.12359. View

17.

Quinn T, Elliott E, Langhorne P . Cognitive and Mood Assessment Tools for Use in Stroke. Stroke. 2017; 49(2):483-490. DOI: 10.1161/STROKEAHA.117.016994. View

18.

Demeyere N, Riddoch M, Slavkova E, Jones K, Reckless I, Mathieson P . Domain-specific versus generalized cognitive screening in acute stroke. J Neurol. 2015; 263(2):306-315. PMC: 4751179. DOI: 10.1007/s00415-015-7964-4. View

19.

Schenkenberg T, Bradford D, AJAX E . Line bisection and unilateral visual neglect in patients with neurologic impairment. Neurology. 1980; 30(5):509-17. DOI: 10.1212/wnl.30.5.509. View

20.

Valera-Gran D, Lopez-Roig S, Hurtado-Pomares M, Peral-Gomez P, Garcia-Manzanares M, Sunyer Catlla M . Validation of the Spanish version of the Oxford Cognitive Screen (S-OCS): psychometric properties of a short cognitive stroke-specific screening tool. Clin Rehabil. 2018; 33(4):724-736. DOI: 10.1177/0269215518819046. View