Validation of the NIH Toolbox Cognitive Battery in Intellectual Disability

Overview

Journal Neurology

Specialty Neurology

Date 2020 Feb 26

PMID 32094241

Citations 29

Authors

Rebecca H Shields

Aaron J Kaat

Forrest J McKenzie

Andrea Drayton

Stephanie M Sansone

Jeanine Coleman

Claire Michalak

Karen Riley

Elizabeth Berry-Kravis

Richard C Gershon

Keith F Widaman

David Hessl

Affiliations

Soon will be listed here.

Abstract

Objective: To advance the science of cognitive outcome measurement for individuals with intellectual disability (ID), we established administration guidelines and evaluated the psychometric properties of the NIH-Toolbox Cognitive Battery (NIHTB-CB) for use in clinical research.

Methods: We assessed feasibility, test-retest reliability, and convergent validity of the NIHTB-CB (measuring executive function, processing speed, memory, and language) by assessing 242 individuals with fragile X syndrome (FXS), Down syndrome (DS), and other ID, ages 6 through 25 years, with retesting completed after 1 month. To facilitate accessibility and measurement accuracy, we developed accommodations and standard assessment guidelines, documented in an e-manual. Finally, we assessed the sensitivity of the battery to expected syndrome-specific cognitive phenotypes.

Results: Above a mental age of 5.0 years, all tests had excellent feasibility. More varied feasibility across tests was seen between mental ages of 3 and 4 years. Reliability and convergent validity ranged from moderate to strong. Each test and the Crystallized and Fluid Composite scores correlated moderately to strongly with IQ, and the Crystallized Composite had modest correlations with adaptive behavior. The NIHTB-CB showed known-groups validity by detecting expected executive function deficits in FXS and a receptive language deficit in DS.

Conclusion: The NIHTB-CB is a reliable and valid test battery for children and young adults with ID with a mental age of ≈5 years and above. Adaptations for very low-functioning or younger children with ID are needed for some subtests to expand the developmental range of the battery. Studies examining sensitivity to developmental and treatment changes are now warranted.

Citing Articles

Computer and tablet assessments of executive function in youth with Down syndrome: feasibility and predictors of performance.

Schworer E, Esbensen A Int J Dev Disabil. 2025; 71(2):227-236.

PMID: 39990087 PMC: 11843650. DOI: 10.1080/20473869.2023.2230409.

Neuroimaging Correlates of the NIH-Toolbox-Driven Cognitive Metrics in Children.

Acosta-Rodriguez H, Yuan C, Bobba P, Stephan A, Zeevi T, Malhotra A J Integr Neurosci. 2024; 23(12):217.

PMID: 39735971 PMC: 11851640. DOI: 10.31083/j.jin2312217.

The validity of studying healthy aging with cognitive tests measuring different constructs.

Hatahet O, L Seghier M Sci Rep. 2024; 14(1):23880.

PMID: 39396067 PMC: 11470937. DOI: 10.1038/s41598-024-74488-0.

Developmental associations between cognition and adaptive behavior in intellectual and developmental disability.

Dakopolos A, Condy E, Smith E, Harvey D, Kaat A, Coleman J J Neurodev Disord. 2024; 16(1):31.

PMID: 38872099 PMC: 11177479. DOI: 10.1186/s11689-024-09542-z.

Greater social jetlag predicts poorer NIH Toolbox crystallized cognitive and academic performance in the Adolescent Brain Cognitive Development (ABCD) study.

Li A, Thomas M, Gonzalez M, McCarthy M, Hasler B, Tapert S Chronobiol Int. 2024; 41(6):829-839.

PMID: 38771191 PMC: 11292803. DOI: 10.1080/07420528.2024.2353848.

References

Weintraub S, Bauer P, Zelazo P, Wallner-Allen K, Dikmen S, Heaton R . I. NIH Toolbox Cognition Battery (CB): introduction and pediatric data. Monogr Soc Res Child Dev. 2013; 78(4):1-15. PMC: 3954750. DOI: 10.1111/mono.12031. View

Wilding J, Cornish K, Munir F . Further delineation of the executive deficit in males with fragile-X syndrome. Neuropsychologia. 2002; 40(8):1343-9. DOI: 10.1016/s0028-3932(01)00212-3. View

Mungas D, Widaman K, Zelazo P, Tulsky D, Heaton R, Slotkin J . VII. NIH Toolbox Cognition Battery (CB): factor structure for 3 to 15 year olds. Monogr Soc Res Child Dev. 2013; 78(4):103-18. PMC: 3950958. DOI: 10.1111/mono.12037. View

Picker J, Walsh C . New innovations: therapeutic opportunities for intellectual disabilities. Ann Neurol. 2013; 74(3):382-90. PMC: 3876407. DOI: 10.1002/ana.24002. View

Casaletto K, Umlauf A, Beaumont J, Gershon R, Slotkin J, Akshoomoff N . Demographically Corrected Normative Standards for the English Version of the NIH Toolbox Cognition Battery. J Int Neuropsychol Soc. 2015; 21(5):378-91. PMC: 4490030. DOI: 10.1017/S1355617715000351. View

Berry-Kravis E, Lindemann L, Jonch A, Apostol G, Bear M, Carpenter R . Drug development for neurodevelopmental disorders: lessons learned from fragile X syndrome. Nat Rev Drug Discov. 2017; 17(4):280-299. PMC: 6904225. DOI: 10.1038/nrd.2017.221. View

Parker S, Mai C, Canfield M, Rickard R, Wang Y, Meyer R . Updated National Birth Prevalence estimates for selected birth defects in the United States, 2004-2006. Birth Defects Res A Clin Mol Teratol. 2010; 88(12):1008-16. DOI: 10.1002/bdra.20735. View

Esbensen A, Hooper S, Fidler D, Hartley S, Edgin J, Liogier DArdhuy X . Outcome Measures for Clinical Trials in Down Syndrome. Am J Intellect Dev Disabil. 2017; 122(3):247-281. PMC: 5424621. DOI: 10.1352/1944-7558-122.3.247. View

. Developmental disabilities among children younger than 5 years in 195 countries and territories, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Glob Health. 2018; 6(10):e1100-e1121. PMC: 6139259. DOI: 10.1016/S2214-109X(18)30309-7. View

10.

Hunter J, Rivero-Arias O, Angelov A, Kim E, Fotheringham I, Leal J . Epidemiology of fragile X syndrome: a systematic review and meta-analysis. Am J Med Genet A. 2014; 164A(7):1648-58. DOI: 10.1002/ajmg.a.36511. View

11.

Lee A, Ventola P, Budimirovic D, Berry-Kravis E, Visootsak J . Clinical Development of Targeted Fragile X Syndrome Treatments: An Industry Perspective. Brain Sci. 2018; 8(12). PMC: 6315847. DOI: 10.3390/brainsci8120214. View

12.

Akshoomoff N, Beaumont J, Bauer P, Dikmen S, Gershon R, Mungas D . VIII. NIH Toolbox Cognition Battery (CB): composite scores of crystallized, fluid, and overall cognition. Monogr Soc Res Child Dev. 2013; 78(4):119-32. PMC: 4103789. DOI: 10.1111/mono.12038. View

13.

Sansone S, Schneider A, Bickel E, Berry-Kravis E, Prescott C, Hessl D . Improving IQ measurement in intellectual disabilities using true deviation from population norms. J Neurodev Disord. 2015; 6(1):16. PMC: 4613563. DOI: 10.1186/1866-1955-6-16. View

14.

Pennington B, Moon J, Edgin J, Stedron J, Nadel L . The neuropsychology of Down syndrome: evidence for hippocampal dysfunction. Child Dev. 2003; 74(1):75-93. DOI: 10.1111/1467-8624.00522. View

15.

Wiebe S, Espy K, Charak D . Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Dev Psychol. 2008; 44(2):575-87. DOI: 10.1037/0012-1649.44.2.575. View

16.

Vicari S, Bellucci S, Carlesimo G . Implicit and explicit memory: a functional dissociation in persons with Down syndrome. Neuropsychologia. 2000; 38(3):240-51. DOI: 10.1016/s0028-3932(99)00081-0. View

17.

Hessl D, Sansone S, Berry-Kravis E, Riley K, Widaman K, Abbeduto L . The NIH Toolbox Cognitive Battery for intellectual disabilities: three preliminary studies and future directions. J Neurodev Disord. 2016; 8(1):35. PMC: 5012003. DOI: 10.1186/s11689-016-9167-4. View

18.

Gershon R, Wagster M, Hendrie H, Fox N, Cook K, Nowinski C . NIH toolbox for assessment of neurological and behavioral function. Neurology. 2013; 80(11 Suppl 3):S2-6. PMC: 3662335. DOI: 10.1212/WNL.0b013e3182872e5f. View

19.

Weintraub S, Dikmen S, Heaton R, Tulsky D, Zelazo P, Bauer P . Cognition assessment using the NIH Toolbox. Neurology. 2013; 80(11 Suppl 3):S54-64. PMC: 3662346. DOI: 10.1212/WNL.0b013e3182872ded. View

20.

Dykens E, Hodapp R, Leckman J . Strengths and weaknesses in the intellectual functioning of males with fragile X syndrome. Am J Ment Defic. 1987; 92(2):234-6. View