A Massive Dataset of the NeuroCognitive Performance Test, a Web-based Cognitive Assessment

Overview

Journal Sci Data

Specialty Science

Date 2022 Dec 9

PMID 36481748

Authors

Paul I Jaffe

Aaron Kaluszka

Nicole F Ng

Robert J Schafer

Affiliations

Soon will be listed here.

Abstract

We present a dataset of approximately 5.5 million subtest scores from over 750,000 adults who completed the NeuroCognitive Performance Test (NCPT; Lumos Labs, Inc.), a validated, self-administered cognitive test accessed via web browser. The dataset includes assessment scores from eight test batteries consisting of 5-11 subtests that collectively span several cognitive domains including working memory, visual attention, and abstract reasoning. In addition to the raw scores and normative data from each subtest, the dataset includes basic demographic information from each participant (age, gender, and educational background). The scale and diversity of the dataset provides an unprecedented opportunity for researchers to investigate population-level variability in cognitive abilities and their relation to demographic factors. To facilitate reuse of this dataset by other researchers, we provide a Python module that supports several common preprocessing steps.

Citing Articles

Cognitive flexibility training for chronic pain: a randomized clinical study.

Holzer K, Todorovic M, Wilson E, Steinberg A, Avidan M, Haroutounian S Pain Rep. 2024; 9(2):e1120.

PMID: 38352025 PMC: 10863938. DOI: 10.1097/PR9.0000000000001120.

Web-based cognitive assessment in older adults: Where do we stand?.

Belleville S, LaPlume A, Purkart R Curr Opin Neurol. 2023; 36(5):491-497.

PMID: 37591303 PMC: 10487375. DOI: 10.1097/WCO.0000000000001192.

Transfer of learning: Analysis of dose-response functions from a large-scale, online, cognitive training dataset.

Osman A, Jaffe P, Ng N, Kerlan K, Schafer R PLoS One. 2023; 18(5):e0281095.

PMID: 37195927 PMC: 10191334. DOI: 10.1371/journal.pone.0281095.

A massive dataset of the NeuroCognitive Performance Test, a web-based cognitive assessment.

Jaffe P, Kaluszka A, Ng N, Schafer R Sci Data. 2022; 9(1):758.

PMID: 36481748 PMC: 9731954. DOI: 10.1038/s41597-022-01872-8.

References

McCrea S, Robinson T . Visual Puzzles, Figure Weights, and Cancellation: Some Preliminary Hypotheses on the Functional and Neural Substrates of These Three New WAIS-IV Subtests. ISRN Neurol. 2012; 2011:123173. PMC: 3263563. DOI: 10.5402/2011/123173. View

Raven J . The Raven's progressive matrices: change and stability over culture and time. Cogn Psychol. 2000; 41(1):1-48. DOI: 10.1006/cogp.1999.0735. View

Ackerman P, Beier M, Boyle M . Individual differences in working memory within a nomological network of cognitive and perceptual speed abilities. J Exp Psychol Gen. 2002; 131(4):567-89. View

Ball K, Beard B, Roenker D, Miller R, Griggs D . Age and visual search: expanding the useful field of view. J Opt Soc Am A. 1988; 5(12):2210-9. DOI: 10.1364/josaa.5.002210. View

Jaeger J . Digit Symbol Substitution Test: The Case for Sensitivity Over Specificity in Neuropsychological Testing. J Clin Psychopharmacol. 2018; 38(5):513-519. PMC: 6291255. DOI: 10.1097/JCP.0000000000000941. View

Opdebeeck C, Martyr A, Clare L . Cognitive reserve and cognitive function in healthy older people: a meta-analysis. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2015; 23(1):40-60. DOI: 10.1080/13825585.2015.1041450. View

Posner M . Orienting of attention. Q J Exp Psychol. 1980; 32(1):3-25. DOI: 10.1080/00335558008248231. View

Ng N, Osman A, Kerlan K, Doraiswamy P, Schafer R . Computerized Cognitive Training by Healthy Older and Younger Adults: Age Comparisons of Overall Efficacy and Selective Effects on Cognition. Front Neurol. 2021; 11:564317. PMC: 7832391. DOI: 10.3389/fneur.2020.564317. View

Guerra-Carrillo B, Katovich K, Bunge S . Does higher education hone cognitive functioning and learning efficacy? Findings from a large and diverse sample. PLoS One. 2017; 12(8):e0182276. PMC: 5568102. DOI: 10.1371/journal.pone.0182276. View

10.

Littman R, Takacs A . Do all inhibitions act alike? A study of go/no-go and stop-signal paradigms. PLoS One. 2017; 12(10):e0186774. PMC: 5655479. DOI: 10.1371/journal.pone.0186774. View

11.

Steyvers M, Schafer R . Inferring latent learning factors in large-scale cognitive training data. Nat Hum Behav. 2020; 4(11):1145-1155. DOI: 10.1038/s41562-020-00935-3. View

12.

Oberauer K, Kliegl R . Simultaneous cognitive operations in working memory after dual-task practice. J Exp Psychol Hum Percept Perform. 2004; 30(4):689-707. DOI: 10.1037/0096-1523.30.4.689. View

13.

Shapiro A, Benedict R, Schretlen D, Brandt J . Construct and concurrent validity of the Hopkins Verbal Learning Test-revised. Clin Neuropsychol. 2000; 13(3):348-58. DOI: 10.1076/clin.13.3.348.1749. View

14.

Engle R, Tuholski S, Laughlin J, Conway A . Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. J Exp Psychol Gen. 1999; 128(3):309-331. DOI: 10.1037//0096-3445.128.3.309. View

15.

Juncos-Rabadan O, Pereiro A, Facal D, Reboredo A, Lojo-Seoane C . Do the Cambridge Neuropsychological Test Automated Battery episodic memory measures discriminate amnestic mild cognitive impairment?. Int J Geriatr Psychiatry. 2013; 29(6):602-9. DOI: 10.1002/gps.4042. View

16.

Hardy J, Nelson R, Thomason M, Sternberg D, Katovich K, Farzin F . Enhancing Cognitive Abilities with Comprehensive Training: A Large, Online, Randomized, Active-Controlled Trial. PLoS One. 2015; 10(9):e0134467. PMC: 4557999. DOI: 10.1371/journal.pone.0134467. View

17.

Peng B, Yu R, Dehoff K, Amos C . Normalizing a large number of quantitative traits using empirical normal quantile transformation. BMC Proc. 2008; 1 Suppl 1:S156. PMC: 2367615. DOI: 10.1186/1753-6561-1-s1-s156. View

18.

Morrison G, Simone C, Ng N, Hardy J . Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment. Front Psychol. 2015; 6:1652. PMC: 4630791. DOI: 10.3389/fpsyg.2015.01652. View

19.

Alosco M, Tripodis Y, Baucom Z, Mez J, Stein T, Martin B . Late contributions of repetitive head impacts and TBI to depression symptoms and cognition. Neurology. 2020; 95(7):e793-e804. PMC: 7605500. DOI: 10.1212/WNL.0000000000010040. View

20.

Doraiswamy P, Goldberg T, Qian M, Linares A, Nwosu A, Nino I . Validity of the Web-Based, Self-Directed, NeuroCognitive Performance Test in Mild Cognitive Impairment. J Alzheimers Dis. 2022; 86(3):1131-1136. DOI: 10.3233/JAD-220015. View