Feasibility of Remote Performance Assessment Using the Free Research Executive Evaluation Test Battery in Adolescents

Overview

Journal Front Psychol

Date 2021 Nov 1

PMID 34721181

Citations 2

Authors

Isis Angelica Segura

Sabine Pompeia

Affiliations

Soon will be listed here.

Abstract

Lockdowns and other preventive measures taken to curb the spread of diseases such as COVID-19 have restricted the use of face-to-face cognitive assessment. Remote testing may be an alternative, but it should first be shown to be comparable to in-person assessment before being used more widely, during and after the pandemic. Our aim was to evaluate the suitability of online, examiner-mediated administration of an open-access battery of executive function tests (the Free Research Executive Evaluation battery, or FREE) that can be adapted considering various characteristics of diverse populations and therefore used worldwide. A total of 96 9-15-year olds (42 girls) were tested, half of whom online through video calls mediated by an examiner. Their performance was compared to that of the other 48 individuals tested face-to-face, who were matched against the online-tested participants for age, pubertal status, sex, and parental schooling. The battery consists of two tests of the following executive domains: Updating (2-Back and Number Memory tests), Inhibition (Stroop Victoria and Stroop Happy-Sad), and Switching (Color Shape and Category Switch). Answers were vocal and self-paced, and the examiner recorded accuracy and time taken to complete in-person and online tasks. Only free software is needed for the assessment. Executive measures obtained from the tasks did not differ statistically between online and in-person tested participants and effects sizes of group effects were small, thus showing that the FREE test battery holds promise for online cognitive assessment, pending confirmation in different samples and further validation studies.

Citing Articles

Cognition and wellbeing in middle-aged early treated people with phenylketonuria: Preliminary results and methodological lessons.

Thomas L, Aitkenhead L, Stepien K, Woodall A, MacDonald A, Romani C Mol Genet Metab Rep. 2024; 41:101160.

PMID: 39639994 PMC: 11617784. DOI: 10.1016/j.ymgmr.2024.101160.

Remote Testing of Reading Comprehension in 8-Year-Old Children: Mode and Setting Effects.

Gnambs T, Lenhard W Assessment. 2023; 31(2):248-262.

PMID: 36890734 PMC: 10822056. DOI: 10.1177/10731911231159369.

References

Creswell C, Shum A, Pearcey S, Skripkauskaite S, Patalay P, Waite P . Young people's mental health during the COVID-19 pandemic. Lancet Child Adolesc Health. 2021; 5(8):535-537. PMC: 9765398. DOI: 10.1016/S2352-4642(21)00177-2. View

McGraw K, Tew M, Williams J . The integrity of Web-delivered experiments: can you trust the data?. Psychol Sci. 2001; 11(6):502-6. DOI: 10.1111/1467-9280.00296. View

Hunersen K, Ramaiya A, Yu C, Green J, Pinandari A, Blum R . Considerations for Remote Data Collection Among Adolescents During the COVID-19 Pandemic. J Adolesc Health. 2021; 68(3):439-440. PMC: 7921833. DOI: 10.1016/j.jadohealth.2020.11.020. View

Zanini G, Miranda M, Cogo-Moreira H, Nouri A, Fernandez A, Pompeia S . An Adaptable, Open-Access Test Battery to Study the Fractionation of Executive-Functions in Diverse Populations. Front Psychol. 2021; 12:627219. PMC: 8042159. DOI: 10.3389/fpsyg.2021.627219. View

Ritchie K, Chan D . The emergence of cognitive COVID. World Psychiatry. 2021; 20(1):52-53. PMC: 7801840. DOI: 10.1002/wps.20837. View

Worhach J, Boduch M, Zhang B, Maski K . Remote Assessment of Pediatric Patients with Daytime Sleepiness and Healthy Controls: A Pilot Study of Feasibility and Reliability. Child Neurol Open. 2021; 8:2329048X211048064. PMC: 8512221. DOI: 10.1177/2329048X211048064. View

Vandierendonck A . A comparison of methods to combine speed and accuracy measures of performance: A rejoinder on the binning procedure. Behav Res Methods. 2016; 49(2):653-673. DOI: 10.3758/s13428-016-0721-5. View

Pompeia S, Zanini G, Freitas R, Inacio L, Silva F, Souza G . Adapted version of the Pubertal Development Scale for use in Brazil. Rev Saude Publica. 2019; 53:56. PMC: 6703897. DOI: 10.11606/s1518-8787.2019053000915. View

Henrich J, Heine S, Norenzayan A . The weirdest people in the world?. Behav Brain Sci. 2010; 33(2-3):61-83. DOI: 10.1017/S0140525X0999152X. View

10.

Geddes M, OConnell M, Fisk J, Gauthier S, Camicioli R, Ismail Z . Remote cognitive and behavioral assessment: Report of the Alzheimer Society of Canada Task Force on dementia care best practices for COVID-19. Alzheimers Dement (Amst). 2020; 12(1):e12111. PMC: 7507991. DOI: 10.1002/dad2.12111. View

11.

Hodge M, Sutherland R, Jeng K, Bale G, Batta P, Cambridge A . Agreement between telehealth and face-to-face assessment of intellectual ability in children with specific learning disorder. J Telemed Telecare. 2018; 25(7):431-437. DOI: 10.1177/1357633X18776095. View

12.

Foulkes L, Blakemore S . Studying individual differences in human adolescent brain development. Nat Neurosci. 2018; 21(3):315-323. DOI: 10.1038/s41593-018-0078-4. View

13.

Soto C, John O, Gosling S, Potter J . Age differences in personality traits from 10 to 65: Big Five domains and facets in a large cross-sectional sample. J Pers Soc Psychol. 2010; 100(2):330-48. DOI: 10.1037/a0021717. View

14.

Karr J, Areshenkoff C, Rast P, Hofer S, Iverson G, Garcia-Barrera M . The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychol Bull. 2018; 144(11):1147-1185. PMC: 6197939. DOI: 10.1037/bul0000160. View

15.

Rad M, Martingano A, Ginges J . Toward a psychology of : Making psychological science more representative of the human population. Proc Natl Acad Sci U S A. 2018; 115(45):11401-11405. PMC: 6233089. DOI: 10.1073/pnas.1721165115. View

16.

Sucksmith E, Allison C, Baron-Cohen S, Chakrabarti B, Hoekstra R . Empathy and emotion recognition in people with autism, first-degree relatives, and controls. Neuropsychologia. 2012; 51(1):98-105. PMC: 6345368. DOI: 10.1016/j.neuropsychologia.2012.11.013. View

17.

Moffitt T, Arseneault L, Belsky D, Dickson N, Hancox R, Harrington H . A gradient of childhood self-control predicts health, wealth, and public safety. Proc Natl Acad Sci U S A. 2011; 108(7):2693-8. PMC: 3041102. DOI: 10.1073/pnas.1010076108. View

18.

Hertting O . More research is needed on the long-term effects of COVID-19 on children and adolescents. Acta Paediatr. 2021; 110(3):744-745. PMC: 7986825. DOI: 10.1111/apa.15731. View

19.

Carskadon M, Vieira C, Acebo C . Association between puberty and delayed phase preference. Sleep. 1993; 16(3):258-62. DOI: 10.1093/sleep/16.3.258. View

20.

Castelli F, Sarvary M . Why students do not turn on their video cameras during online classes and an equitable and inclusive plan to encourage them to do so. Ecol Evol. 2021; 11(8):3565-3576. PMC: 8057329. DOI: 10.1002/ece3.7123. View