Response Time Reduction Due to Retesting in Mental Speed Tests: A Meta-Analysis

Overview

Journal J Intell

Specialty Biomedical Engineering

Date 2019 Jun 5

PMID 31162433

Citations 10

Authors

Jana Scharfen

Diego Blum

Heinz Holling

Affiliations

Soon will be listed here.

Abstract

As retest effects in cognitive ability tests have been investigated by various primary and meta-analytic studies, most studies from this area focus on score gains as a result of retesting. To the best of our knowledge, no meta-analytic study has been reported that provides sizable estimates of response time (RT) reductions due to retesting. This multilevel meta-analysis focuses on mental speed tasks, for which outcome measures often consist of RTs. The size of RT reduction due to retesting in mental speed tasks for up to four test administrations was analyzed based on 36 studies including 49 samples and 212 outcomes for a total sample size of 21,810. Significant RT reductions were found, which increased with the number of test administrations, without reaching a plateau. Larger RT reductions were observed in more complex mental speed tasks compared to simple ones, whereas age and test-retest interval mostly did not moderate the size of the effect. Although a high heterogeneity of effects exists, retest effects were shown to occur for mental speed tasks regarding RT outcomes and should thus be more thoroughly accounted for in applied and research settings.

Citing Articles

Practice effects in cognitive assessments three years later in non-carriers but not in symptom-free mutation carriers of autosomal-dominant Alzheimer's disease: Exemplifying procedural learning and memory?.

Almkvist O, Graff C Front Aging Neurosci. 2022; 14:905329.

PMID: 36275006 PMC: 9580215. DOI: 10.3389/fnagi.2022.905329.

On doing multi-act arithmetic: A multitrait-multimethod approach of performance dimensions in integrated multitasking.

Schumann F, Steinborn M, Flehmig H, Kurten J, Langner R, Huestegge L Front Psychol. 2022; 13:946626.

PMID: 36059769 PMC: 9433926. DOI: 10.3389/fpsyg.2022.946626.

Computerized Working Memory Training in Remission From Major Depressive Disorder: Effects on Emotional Working Memory, Processing Speed, Executive Functions, and Associations With Symptoms.

Ronold E, Joormann J, Hammar A Front Behav Neurosci. 2022; 16:887596.

PMID: 35832292 PMC: 9272008. DOI: 10.3389/fnbeh.2022.887596.

Dry Eye and Phacoemulsification Cataract Surgery: A Systematic Review and Meta-Analysis.

Lu Q, Lu Y, Zhu X Front Med (Lausanne). 2021; 8:649030.

PMID: 34307395 PMC: 8295542. DOI: 10.3389/fmed.2021.649030.

Computerized Symbol Digit Modalities Test in a Swiss Pediatric Cohort Part 1: Validation.

Hochstrasser C, Rieder S, Jufer-Riedi U, Klein M, Feinstein A, Banwell B Front Psychol. 2021; 12:631536.

PMID: 33967898 PMC: 8101631. DOI: 10.3389/fpsyg.2021.631536.

References

Shanks D, Johnstone T . Evaluating the relationship between explicit and implicit knowledge in a sequential reaction time task. J Exp Psychol Learn Mem Cogn. 1999; 25(6):1435-51. DOI: 10.1037//0278-7393.25.6.1435. View

Heathcote A, Brown S, Mewhort D . The power law repealed: the case for an exponential law of practice. Psychon Bull Rev. 2000; 7(2):185-207. DOI: 10.3758/bf03212979. View

Sterne J, Egger M . Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. J Clin Epidemiol. 2001; 54(10):1046-55. DOI: 10.1016/s0895-4356(01)00377-8. View

Morris S, DeShon R . Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods. 2002; 7(1):105-25. DOI: 10.1037/1082-989x.7.1.105. View

Hausknecht J, Trevor C, Farr J . Retaking ability tests in a selection setting: implications for practice effects, training performance, and turnover. J Appl Psychol. 2002; 87(2):243-54. DOI: 10.1037/0021-9010.87.2.243. View

Braver T, Barch D . A theory of cognitive control, aging cognition, and neuromodulation. Neurosci Biobehav Rev. 2002; 26(7):809-17. DOI: 10.1016/s0149-7634(02)00067-2. View

Collie A, Maruff P, Darby D, McStephen M . The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. J Int Neuropsychol Soc. 2003; 9(3):419-28. DOI: 10.1017/S1355617703930074. View

Howard D, Howard Jr J, Japikse K, Diyanni C, Thompson A, Somberg R . Implicit sequence learning: effects of level of structure, adult age, and extended practice. Psychol Aging. 2004; 19(1):79-92. PMC: 1224741. DOI: 10.1037/0882-7974.19.1.79. View

Melzer I, Oddsson L . The effect of a cognitive task on voluntary step execution in healthy elderly and young individuals. J Am Geriatr Soc. 2004; 52(8):1255-62. DOI: 10.1111/j.1532-5415.2004.52353.x. View

10.

Salthouse T, Schroeder D, Ferrer E . Estimating retest effects in longitudinal assessments of cognitive functioning in adults between 18 and 60 years of age. Dev Psychol. 2004; 40(5):813-22. DOI: 10.1037/0012-1649.40.5.813. View

11.

Lemay S, Bedard M, Rouleau I, Tremblay P . Practice effect and test-retest reliability of attentional and executive tests in middle-aged to elderly subjects. Clin Neuropsychol. 2004; 18(2):284-302. DOI: 10.1080/13854040490501718. View

12.

Levine A, Miller E, Becker J, Selnes O, Cohen B . Normative data for determining significance of test-retest differences on eight common neuropsychological instruments. Clin Neuropsychol. 2005; 18(3):373-84. DOI: 10.1080/1385404049052420. View

13.

Roediger H, Karpicke J . Test-enhanced learning: taking memory tests improves long-term retention. Psychol Sci. 2006; 17(3):249-55. DOI: 10.1111/j.1467-9280.2006.01693.x. View

14.

Ruthruff E, Van Selst M, Johnston J, Remington R . How does practice reduce dual-task interference: integration, automatization, or just stage-shortening?. Psychol Res. 2006; 70(2):125-42. DOI: 10.1007/s00426-004-0192-7. View

15.

Falleti M, Maruff P, Collie A, Darby D . Practice effects associated with the repeated assessment of cognitive function using the CogState battery at 10-minute, one week and one month test-retest intervals. J Clin Exp Neuropsychol. 2006; 28(7):1095-112. DOI: 10.1080/13803390500205718. View

16.

Hausknecht J, Halpert J, Di Paolo N, Moriarty Gerrard M . Retesting in selection: a meta-analysis of coaching and practice effects for tests of cognitive ability. J Appl Psychol. 2007; 92(2):373-85. DOI: 10.1037/0021-9010.92.2.373. View

17.

Baird B, Tombaugh T, Francis M . The effects of practice on speed of information processing using the Adjusting-Paced Serial Addition Test (Adjusting-PSAT) and the Computerized Tests of Information Processing (CTIP). Appl Neuropsychol. 2007; 14(2):88-100. DOI: 10.1080/09084280701319912. View

18.

Ball K, Edwards J, Ross L . The impact of speed of processing training on cognitive and everyday functions. J Gerontol B Psychol Sci Soc Sci. 2007; 62 Spec No 1:19-31. DOI: 10.1093/geronb/62.special_issue_1.19. View

19.

Langenecker S, Zubieta J, Young E, Akil H, Nielson K . A task to manipulate attentional load, set-shifting, and inhibitory control: convergent validity and test-retest reliability of the Parametric Go/No-Go Test. J Clin Exp Neuropsychol. 2007; 29(8):842-53. DOI: 10.1080/13803390601147611. View

20.

Buck K, Atkinson T, Ryan J . Evidence of practice effects in variants of the Trail Making Test during serial assessment. J Clin Exp Neuropsychol. 2007; 30(3):312-8. DOI: 10.1080/13803390701390483. View