NIH Toolbox Executive Function Measures with Developmental Extensions: Reliability and Validity with Preschoolers in Emergency Housing

Research has shown that executive function (EF) skills are associated with resilience in preschoolers experiencing risk and adversity, but these studies have typically relied on large batteries of tasks to measure children's EF skills. There is a need for brief, reliable EF assessments that can be used in the field with diverse young children. The current study assessed the validity and test-retest reliability of two tablet-based EF tasks from the NIH Toolbox: The Dimensional Change Card Sort (DCCS) and the Flanker Inhibitory Control and Attention Test, each with a developmental extension (Dext) that is triggered when a child struggles with the standardized versions. Dext versions include easier levels intended to improve task accessibility for younger and disadvantaged children. Eighty-six preschoolers residing in emergency housing participated in two study sessions about one week apart, completing tablet-based DCCS-Dext and Flanker-Dext tasks, along with a table-top EF task (Peg-Tapping) and measures of vocabulary and numeracy. The majority of participants triggered the Dext portion of the DCCS and almost half triggered the Dext portion of the Flanker, underscoring the need for extensions of the Toolbox EF tasks to lower the floor of these measures. The Dext EF measures were positively associated with Peg-Tapping, after controlling for age and vocabulary, indicating construct validity. They were also correlated with math achievement, suggesting criterion validity. DCCS-Dext and Flanker-Dext showed moderate test-retest reliability after one week. Together, these findings demonstrate the value of developmental extensions for assessing EF skills among children experiencing risk and adversity.