NIH Toolbox Cognition Battery (NIHTB-CB): List Sorting Test to Measure Working Memory

Overview

Journal J Int Neuropsychol Soc

Publisher Cambridge University Press

Specialties Neurology
Psychology

Date 2014 Jun 25

PMID 24959983

Citations 102

Authors

David S Tulsky

Noelle Carlozzi

Nancy D Chiaravalloti

Jennifer L Beaumont

Pamela A Kisala

Dan Mungas

Kevin Conway

Richard Gershon

Affiliations

Soon will be listed here.

Abstract

The List Sorting Working Memory Test was designed to assess working memory (WM) as part of the NIH Toolbox Cognition Battery. List Sorting is a sequencing task requiring children and adults to sort and sequence stimuli that are presented visually and auditorily. Validation data are presented for 268 participants ages 20 to 85 years. A subset of participants (N=89) was retested 7 to 21 days later. As expected, the List Sorting Test had moderately high correlations with other measures of working memory and executive functioning (convergent validity) but a low correlation with a test of receptive vocabulary (discriminant validity). Furthermore, List Sorting demonstrates expected changes over the age span and has excellent test-retest reliability. Collectively, these results provide initial support for the construct validity of the List Sorting Working Memory Measure as a measure of working memory. However, the relationship between the List Sorting Test and general executive function has yet to be determined.

Citing Articles

How attention and working memory work together in the pursuit of goals: The development of the sampling-remembering trade-off.

Blaser E, Kaldy Z Dev Rev. 2025; 75.

PMID: 39990591 PMC: 11845231. DOI: 10.1016/j.dr.2025.101187.

Mobile Toolbox sequences task: development and validation of a remote, smartphone-based working memory test.

Slotkin J, Kaat A, Young S, Dworak E, Novack M, Shono Y Front Psychol. 2025; 15:1497816.

PMID: 39911192 PMC: 11794243. DOI: 10.3389/fpsyg.2024.1497816.

Effectiveness of Distant/Remote Blessing Treatment on Cognitive-motor Function: A Randomized Double-blind Placebo-controlled Trial.

Branton A, Trivedi M, Trivedi D, Mondal S, Jana S Health Psychol Res. 2025; 13():128098.

PMID: 39830804 PMC: 11741897. DOI: 10.52965/001c.128098.

Interconnected declines in audition vision and cognition in healthy aging.

Abbas M, Szpiro S, Karawani H Sci Rep. 2024; 14(1):30805.

PMID: 39730569 PMC: 11680815. DOI: 10.1038/s41598-024-81154-y.

The theory of mind construct in adulthood: perspective taking in relation to language and executive function.

Montgomery D, Tompkins V, Feng X Front Psychol. 2024; 15:1435685.

PMID: 39687564 PMC: 11648761. DOI: 10.3389/fpsyg.2024.1435685.

References

Salmon E, van der Linden M, Collette F, Delfiore G, Maquet P, Degueldre C . Regional brain activity during working memory tasks. Brain. 1996; 119 ( Pt 5):1617-25. DOI: 10.1093/brain/119.5.1617. View

Hodes R, Insel T, Landis S . The NIH toolbox: setting a standard for biomedical research. Neurology. 2013; 80(11 Suppl 3):S1. PMC: 3662338. DOI: 10.1212/WNL.0b013e3182872e90. View

Gronwall D . Paced auditory serial-addition task: a measure of recovery from concussion. Percept Mot Skills. 1977; 44(2):367-73. DOI: 10.2466/pms.1977.44.2.367. View

Beatty W, Wilbanks S, Blanco C, Hames K, Tivis R, Paul R . Memory disturbance in multiple sclerosis: reconsideration of patterns of performance on the selective reminding test. J Clin Exp Neuropsychol. 1996; 18(1):56-62. DOI: 10.1080/01688639608408262. View

Baddeley A . Is working memory still working?. Am Psychol. 2002; 56(11):851-64. DOI: 10.1037/0003-066x.56.11.851. View

Salthouse T, Mitchell D, Skovronek E, Babcock R . Effects of adult age and working memory on reasoning and spatial abilities. J Exp Psychol Learn Mem Cogn. 1989; 15(3):507-16. DOI: 10.1037//0278-7393.15.3.507. View

Courtney S, Ungerleider L, Keil K, Haxby J . Transient and sustained activity in a distributed neural system for human working memory. Nature. 1997; 386(6625):608-11. DOI: 10.1038/386608a0. View

Hasher L, Stoltzfus E, Zacks R, Rypma B . Age and inhibition. J Exp Psychol Learn Mem Cogn. 1991; 17(1):163-9. DOI: 10.1037//0278-7393.17.1.163. View

Tulsky D, Carlozzi N, Chevalier N, Espy K, Beaumont J, Mungas D . V. NIH Toolbox Cognition Battery (CB): measuring working memory. Monogr Soc Res Child Dev. 2013; 78(4):70-87. PMC: 4427028. DOI: 10.1111/mono.12035. View

10.

Gershon R, Cella D, Fox N, Havlik R, Hendrie H, Wagster M . Assessment of neurological and behavioural function: the NIH Toolbox. Lancet Neurol. 2010; 9(2):138-9. DOI: 10.1016/S1474-4422(09)70335-7. View

11.

Seidman L, Breiter H, Goodman J, Goldstein J, Woodruff P, OCraven K . A functional magnetic resonance imaging study of auditory vigilance with low and high information processing demands. Neuropsychology. 1998; 12(4):505-18. DOI: 10.1037//0894-4105.12.4.505. View

12.

Owen A, Evans A, Petrides M . Evidence for a two-stage model of spatial working memory processing within the lateral frontal cortex: a positron emission tomography study. Cereb Cortex. 1996; 6(1):31-8. DOI: 10.1093/cercor/6.1.31. View

13.

Cohen J . A power primer. Psychol Bull. 2009; 112(1):155-9. DOI: 10.1037//0033-2909.112.1.155. View

14.

Hofmann W, Schmeichel B, Baddeley A . Executive functions and self-regulation. Trends Cogn Sci. 2012; 16(3):174-80. DOI: 10.1016/j.tics.2012.01.006. View

15.

Chiaravalloti N, Hillary F, Ricker J, Christodoulou C, Kalnin A, Liu W . Cerebral activation patterns during working memory performance in multiple sclerosis using FMRI. J Clin Exp Neuropsychol. 2005; 27(1):33-54. DOI: 10.1080/138033990513609. View

16.

Haut M, Kuwabara H, Leach S, Arias R . Neural activation during performance of number-letter sequencing. Appl Neuropsychol. 2001; 7(4):237-42. DOI: 10.1207/S15324826AN0704_5. View

17.

Schmiedek F, Hildebrandt A, Lovden M, Wilhelm O, Lindenberger U . Complex span versus updating tasks of working memory: the gap is not that deep. J Exp Psychol Learn Mem Cogn. 2009; 35(4):1089-1096. DOI: 10.1037/a0015730. View

18.

Edin F, Macoveanu J, Olesen P, Tegner J, Klingberg T . Stronger synaptic connectivity as a mechanism behind development of working memory-related brain activity during childhood. J Cogn Neurosci. 2007; 19(5):750-60. DOI: 10.1162/jocn.2007.19.5.750. View

19.

Messick S . PERSONALITY MEASUREMENT AND THE ETHICS OF ASSESSMENT. Am Psychol. 1965; 20:136-42. DOI: 10.1037/h0021712. View

20.

Baddeley A . Working memory. Curr Biol. 2010; 20(4):R136-40. DOI: 10.1016/j.cub.2009.12.014. View