Reliability and Validity of the NeuroCognitive Performance Test, a Web-based Neuropsychological Assessment

Overview

Journal Front Psychol

Date 2015 Nov 19

PMID 26579035

Citations 45

Authors

Glenn E Morrison

Christa M Simone

Nicole F Ng

Joseph L Hardy

Affiliations

Soon will be listed here.

Abstract

The NeuroCognitive Performance Test (NCPT) is a brief, repeatable, web-based cognitive assessment platform that measures performance across several cognitive domains. The NCPT platform is modular and includes 18 subtests that can be arranged into customized batteries. Here we present normative data from a sample of 130,140 healthy volunteers for an NCPT battery consisting of 8 subtests. Participants took the NCPT remotely and without supervision. Factor structure and effects of age, education, and gender were evaluated with this normative dataset. Test-retest reliability was evaluated in a subset of participants who took the battery again an average of 78.8 days later. The eight NCPT subtests group into 4 putative cognitive domains, have adequate to good test-retest reliability, and are sensitive to expected age- and education-related cognitive effects. Concurrent validity to standard neuropsychological tests was demonstrated in 73 healthy volunteers. In an exploratory analysis the NCPT battery could differentiate those who self-reported Mild Cognitive Impairment or Alzheimer's disease from matched healthy controls. Overall these results demonstrate the reliability and validity of the NCPT battery as a measure of cognitive performance and support the feasibility of web-based, unsupervised testing, with potential utility in clinical and research settings.

Citing Articles

Substantial parallel mediation contribution by cognitive domains in the relationship between adolescents' physical fitness and academic achievements: the Cogni-Action Project.

Cristi-Montero C, Martinez-Flores R, Espinoza-Puelles J, Doherty A, Zavala-Crichton J, Aguilar-Farias N Front Psychol. 2024; 15:1355434.

PMID: 39049947 PMC: 11267617. DOI: 10.3389/fpsyg.2024.1355434.

Effects of night-float shifts on cognitive function among radiology residents.

Flink C, Hobohm R, Zhang B, Jacobson D, England E Emerg Radiol. 2024; 31(5):725-731.

PMID: 39046634 PMC: 11436431. DOI: 10.1007/s10140-024-02269-3.

Adolescents with a Favorable Mediterranean-Style-Based Pattern Show Higher Cognitive and Academic Achievement: A Cluster Analysis-The Cogni-Action Project.

Pena-Jorquera H, Martinez-Flores R, Espinoza-Puelles J, Lopez-Gil J, Ferrari G, Zapata-Lamana R Nutrients. 2024; 16(5).

PMID: 38474736 PMC: 10934130. DOI: 10.3390/nu16050608.

cCOG Web-Based Cognitive Assessment Tool.

Rhodius-Meester H, Paajanen T, Lotjonen J Methods Mol Biol. 2024; 2785:311-320.

PMID: 38427202 DOI: 10.1007/978-1-0716-3774-6_19.

Correlation Between Maternal Anxiety During Mid-Pregnancy and Subsequent Infant Sleep Issues: A Cross-Sectional Study from 2015 to 2016.

Wang S, Cai Z, Gao G, Yan S Int J Gen Med. 2024; 17:623-633.

PMID: 38410242 PMC: 10894751. DOI: 10.2147/IJGM.S445604.

References

Collie A, Maruff P, Darby D, McStephen M . The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. J Int Neuropsychol Soc. 2003; 9(3):419-28. DOI: 10.1017/S1355617703930074. View

ROYER F . Spatial orientational and figural information in free recall of visual figures. J Exp Psychol. 1971; 91(2):326-32. DOI: 10.1037/h0031846. View

Richardson J . Measures of short-term memory: a historical review. Cortex. 2007; 43(5):635-50. DOI: 10.1016/s0010-9452(08)70493-3. View

Salthouse T . The processing-speed theory of adult age differences in cognition. Psychol Rev. 1996; 103(3):403-28. DOI: 10.1037/0033-295x.103.3.403. View

Gualtieri C, Johnson L . Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Arch Clin Neuropsychol. 2006; 21(7):623-43. DOI: 10.1016/j.acn.2006.05.007. View

Hardy J, Nelson R, Thomason M, Sternberg D, Katovich K, Farzin F . Enhancing Cognitive Abilities with Comprehensive Training: A Large, Online, Randomized, Active-Controlled Trial. PLoS One. 2015; 10(9):e0134467. PMC: 4557999. DOI: 10.1371/journal.pone.0134467. View

Robbins T, James M, Owen A, Sahakian B, Lawrence A, McInnes L . A study of performance on tests from the CANTAB battery sensitive to frontal lobe dysfunction in a large sample of normal volunteers: implications for theories of executive functioning and cognitive aging. Cambridge Neuropsychological Test Automated.... J Int Neuropsychol Soc. 1998; 4(5):474-90. DOI: 10.1017/s1355617798455073. View

Kueider A, Parisi J, Gross A, Rebok G . Computerized cognitive training with older adults: a systematic review. PLoS One. 2012; 7(7):e40588. PMC: 3394709. DOI: 10.1371/journal.pone.0040588. View

Keefe R, Goldberg T, Harvey P, Gold J, Poe M, Coughenour L . The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery. Schizophr Res. 2004; 68(2-3):283-97. DOI: 10.1016/j.schres.2003.09.011. View

10.

Dikmen S, Heaton R, Grant I, Temkin N . Test-retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery. J Int Neuropsychol Soc. 1999; 5(4):346-56. View

11.

Lemay S, Bedard M, Rouleau I, Tremblay P . Practice effect and test-retest reliability of attentional and executive tests in middle-aged to elderly subjects. Clin Neuropsychol. 2004; 18(2):284-302. DOI: 10.1080/13854040490501718. View

12.

Raven J . The Raven's progressive matrices: change and stability over culture and time. Cogn Psychol. 2000; 41(1):1-48. DOI: 10.1006/cogp.1999.0735. View

13.

Rabbitt P, Diggle P, Smith D, Holland F, Mc Innes L . Identifying and separating the effects of practice and of cognitive ageing during a large longitudinal study of elderly community residents. Neuropsychologia. 2001; 39(5):532-43. DOI: 10.1016/s0028-3932(00)00099-3. View

14.

Lampit A, Hallock H, Valenzuela M . Computerized cognitive training in cognitively healthy older adults: a systematic review and meta-analysis of effect modifiers. PLoS Med. 2014; 11(11):e1001756. PMC: 4236015. DOI: 10.1371/journal.pmed.1001756. View

15.

Gur R, Richard J, Hughett P, Calkins M, Macy L, Bilker W . A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: standardization and initial construct validation. J Neurosci Methods. 2009; 187(2):254-62. PMC: 2832711. DOI: 10.1016/j.jneumeth.2009.11.017. View

16.

McCrae R, Kurtz J, Yamagata S, Terracciano A . Internal consistency, retest reliability, and their implications for personality scale validity. Pers Soc Psychol Rev. 2010; 15(1):28-50. PMC: 2927808. DOI: 10.1177/1088868310366253. View

17.

Deloche G, Seron X, Larroque C, Magnien C, Noel M, Riva I . Calculation and number processing: assessment battery; role of demographic factors. J Clin Exp Neuropsychol. 1994; 16(2):195-208. DOI: 10.1080/01688639408402631. View

18.

Nuechterlein K, Green M, Kern R, Baade L, Barch D, Cohen J . The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008; 165(2):203-13. DOI: 10.1176/appi.ajp.2007.07010042. View

19.

Rossetti H, Lacritz L, Cullum C, Weiner M . Normative data for the Montreal Cognitive Assessment (MoCA) in a population-based sample. Neurology. 2011; 77(13):1272-5. DOI: 10.1212/WNL.0b013e318230208a. View

20.

Bauer R, Iverson G, Cernich A, Binder L, Ruff R, Naugle R . Computerized neuropsychological assessment devices: joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology. Arch Clin Neuropsychol. 2012; 27(3):362-73. PMC: 3499090. DOI: 10.1093/arclin/acs027. View