Adapting Open Science and Pre-registration to Longitudinal Research

Overview

Journal Infant Child Dev

Date 2024 Mar 1

PMID 38425545

Authors

Isaac T Petersen

Keith S Apfelbaum

Bob McMurray

Affiliations

Soon will be listed here.

Abstract

Open science practices, such as pre-registration and data sharing, increase transparency and may improve the replicability of developmental science. However, developmental science has lagged behind other fields in implementing open science practices. This lag may arise from unique challenges and considerations of longitudinal research. In this paper, preliminary guidelines are provided for adapting open science practices to longitudinal research to facilitate researchers' use of these practices. The guidelines propose a serial and modular approach to registration that includes an initial pre-registration of the methods and focal hypotheses of the longitudinal study, along with subsequent pre- or co-registered questions, hypotheses, and analysis plans associated with specific papers. Researchers are encouraged to share their research materials and relevant data with associated papers, and to report sufficient information for replicability. In addition, there should be careful consideration about requirements regarding the timing of data sharing, to avoid disincentivizing longitudinal research.

Citing Articles

The development of real-time spoken and word recognition derives from changes in ability, not maturation.

Kutlu E, Klein-Packard J, Jeppsen C, Tomblin J, McMurray B Cognition. 2024; 251:105899.

PMID: 39059118 PMC: 11470444. DOI: 10.1016/j.cognition.2024.105899.

A practical guide to cross-cultural and multi-sited data collection in the biological and behavioural sciences.

Spake L, Hassan A, Schaffnit S, Alam N, Amoah A, Badjie J Proc Biol Sci. 2024; 291(2021):20231422.

PMID: 38654647 PMC: 11040250. DOI: 10.1098/rspb.2023.1422.

Passive and social screen time in children with autism and in association with obesity.

Must A, Eliasziw M, Stanish H, Curtin C, Bandini L, Bowling A Front Pediatr. 2023; 11:1198033.

PMID: 37492602 PMC: 10364473. DOI: 10.3389/fped.2023.1198033.

Shedding light on functional near-infrared spectroscopy and open science practices.

Kelsey C, Taylor J, Pirazzoli L, Lorenzo R, Sullivan E, Nelson C Neurophotonics. 2023; 10(2):023520.

PMID: 37077217 PMC: 10109256. DOI: 10.1117/1.NPh.10.2.023520.

I'm not sure that curve means what you think it means: Toward a [more] realistic understanding of the role of eye-movement generation in the Visual World Paradigm.

McMurray B Psychon Bull Rev. 2022; 30(1):102-146.

PMID: 35962241 PMC: 10964151. DOI: 10.3758/s13423-022-02143-8.

References

John L, Loewenstein G, Prelec D . Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol Sci. 2012; 23(5):524-32. DOI: 10.1177/0956797611430953. View

Rosenthal R . Science and ethics in conducting, analyzing, and reporting psychological research. Psychol Sci. 1994; 5(3):127-34. DOI: 10.1111/j.1467-9280.1994.tb00646.x. View

Simmons J, Nelson L, Simonsohn U . False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011; 22(11):1359-66. DOI: 10.1177/0956797611417632. View

Petersen I, Choe D, LeBeau B . Studying a Moving Target in Development: The Challenge and Opportunity of Heterotypic Continuity. Dev Rev. 2020; 58. PMC: 7685252. DOI: 10.1016/j.dr.2020.100935. View

McMurray B, Samelson V, Lee S, Tomblin J . Individual differences in online spoken word recognition: Implications for SLI. Cogn Psychol. 2009; 60(1):1-39. PMC: 3523704. DOI: 10.1016/j.cogpsych.2009.06.003. View

Bakker M, Wicherts J . The (mis)reporting of statistical results in psychology journals. Behav Res Methods. 2011; 43(3):666-78. PMC: 3174372. DOI: 10.3758/s13428-011-0089-5. View

Gilroy S, Kaplan B . Furthering Open Science in Behavior Analysis: An Introduction and Tutorial for Using GitHub in Research. Perspect Behav Sci. 2020; 42(3):565-581. PMC: 6768926. DOI: 10.1007/s40614-019-00202-5. View

. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. 2015; 349(6251):aac4716. DOI: 10.1126/science.aac4716. View

Gilmore R, Lorenzo Kennedy J, Adolph K . Practical Solutions for Sharing Data and Materials From Psychological Research. Adv Methods Pract Psychol Sci. 2019; 1(1):121-130. PMC: 6544443. DOI: 10.1177/2515245917746500. View

10.

Botvinik-Nezer R, Holzmeister F, Camerer C, Dreber A, Huber J, Johannesson M . Variability in the analysis of a single neuroimaging dataset by many teams. Nature. 2020; 582(7810):84-88. PMC: 7771346. DOI: 10.1038/s41586-020-2314-9. View

11.

Button K, Ioannidis J, Mokrysz C, Nosek B, Flint J, Robinson E . Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013; 14(5):365-76. DOI: 10.1038/nrn3475. View

12.

Bakker M, van Dijk A, Wicherts J . The Rules of the Game Called Psychological Science. Perspect Psychol Sci. 2015; 7(6):543-54. DOI: 10.1177/1745691612459060. View

13.

Ioannidis J . Why most published research findings are false. PLoS Med. 2005; 2(8):e124. PMC: 1182327. DOI: 10.1371/journal.pmed.0020124. View

14.

Wicherts J, Borsboom D, Kats J, Molenaar D . The poor availability of psychological research data for reanalysis. Am Psychol. 2006; 61(7):726-8. DOI: 10.1037/0003-066X.61.7.726. View

15.

de Groot A . The meaning of "significance" for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han L. J. van der.... Acta Psychol (Amst). 2014; 148:188-94. DOI: 10.1016/j.actpsy.2014.02.001. View

16.

Bell M, Cuevas K . Using EEG to Study Cognitive Development: Issues and Practices. J Cogn Dev. 2012; 13(3):281-294. PMC: 3491357. DOI: 10.1080/15248372.2012.691143. View

17.

Patrick C, Venables N, Yancey J, Hicks B, Nelson L, Kramer M . A construct-network approach to bridging diagnostic and physiological domains: application to assessment of externalizing psychopathology. J Abnorm Psychol. 2013; 122(3):902-16. PMC: 6573023. DOI: 10.1037/a0032807. View

18.

Hedge C, Powell G, Sumner P . The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behav Res Methods. 2017; 50(3):1166-1186. PMC: 5990556. DOI: 10.3758/s13428-017-0935-1. View

19.

Casey B, Cannonier T, Conley M, Cohen A, Barch D, Heitzeg M . The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites. Dev Cogn Neurosci. 2018; 32:43-54. PMC: 5999559. DOI: 10.1016/j.dcn.2018.03.001. View

20.

Loken E, Gelman A . Measurement error and the replication crisis. Science. 2017; 355(6325):584-585. DOI: 10.1126/science.aal3618. View