Expanding the Data Ark: an Attempt to Make the Data from Highly Cited Social Science Papers Publicly Available

Overview

Journal R Soc Open Sci

Specialty Science

Date 2024 Jul 30

PMID 39076822

Authors

Coby Dulitzki

Steven Michael Crane

Tom E Hardwicke

John P A Ioannidis

Affiliations

Soon will be listed here.

Abstract

Access to scientific data can enable independent reuse and verification; however, most data are not available and become increasingly irrecoverable over time. This study aimed to retrieve and preserve important datasets from 160 of the most highly-cited social science articles published between 2008-2013 and 2015-2018. We asked authors if they would share data in a public repository-the Data Ark-or provide reasons if data could not be shared. Of the 160 articles, data for 117 (73%, 95% CI [67%-80%]) were not available and data for 7 (4%, 95% CI [0%-12%]) were available with restrictions. Data for 36 (22%, 95% CI [16%-30%]) articles were available in unrestricted form: 29 of these datasets were already available and 7 datasets were made available in the Data Ark. Most authors did not respond to our data requests and a minority shared reasons for not sharing, such as legal or ethical constraints. These findings highlight an unresolved need to preserve important scientific datasets and increase their accessibility to the scientific community.

References

Miguel E, Camerer C, Casey K, Cohen J, Esterling K, Gerber A . Social science. Promoting transparency in social science research. Science. 2014; 343(6166):30-1. PMC: 4103621. DOI: 10.1126/science.1245317. View

Vines T, Albert A, Andrew R, Debarre F, Bock D, Franklin M . The availability of research data declines rapidly with article age. Curr Biol. 2013; 24(1):94-97. DOI: 10.1016/j.cub.2013.11.014. View

Serghiou S, Contopoulos-Ioannidis D, Boyack K, Riedel N, Wallach J, Ioannidis J . Assessment of transparency indicators across the biomedical literature: How open is open?. PLoS Biol. 2021; 19(3):e3001107. PMC: 7951980. DOI: 10.1371/journal.pbio.3001107. View

Hardwicke T, Bohn M, MacDonald K, Hembacher E, Nuijten M, Peloquin B . Analytic reproducibility in articles receiving open data badges at the journal : an observational study. R Soc Open Sci. 2021; 8(1):201494. PMC: 7890505. DOI: 10.1098/rsos.201494. View

Hardwicke T, Mathur M, MacDonald K, Nilsonne G, Banks G, Kidwell M . Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal . R Soc Open Sci. 2018; 5(8):180448. PMC: 6124055. DOI: 10.1098/rsos.180448. View

Towse J, Ellis D, Towse A . Opening Pandora's Box: Peeking inside Psychology's data sharing practices, and seven recommendations for change. Behav Res Methods. 2020; 53(4):1455-1468. PMC: 8367918. DOI: 10.3758/s13428-020-01486-1. View

Mansmann U, Locher C, Prasser F, Weissgerber T, Sax U, Posch M . Implementing clinical trial data sharing requires training a new generation of biomedical researchers. Nat Med. 2023; 29(2):298-301. DOI: 10.1038/s41591-022-02080-y. View

Pellen C, Le Louarn A, Spurrier-Bernard G, Decullier E, Chretien J, Rosenthal E . Ten (not so) simple rules for clinical trial data-sharing. PLoS Comput Biol. 2023; 19(3):e1010879. PMC: 9997951. DOI: 10.1371/journal.pcbi.1010879. View

Hardwicke T, Ioannidis J . Populating the Data Ark: An attempt to retrieve, preserve, and liberate data from the most highly-cited psychology and psychiatry articles. PLoS One. 2018; 13(8):e0201856. PMC: 6072126. DOI: 10.1371/journal.pone.0201856. View

10.

Naudet F, Siebert M, Pellen C, Gaba J, Axfors C, Cristea I . Medical journal requirements for clinical trial data sharing: Ripe for improvement. PLoS Med. 2021; 18(10):e1003844. PMC: 8575305. DOI: 10.1371/journal.pmed.1003844. View

11.

Bergeat D, Lombard N, Gasmi A, Le Floch B, Naudet F . Data Sharing and Reanalyses Among Randomized Clinical Trials Published in Surgical Journals Before and After Adoption of a Data Availability and Reproducibility Policy. JAMA Netw Open. 2022; 5(6):e2215209. PMC: 9163999. DOI: 10.1001/jamanetworkopen.2022.15209. View

12.

Vazquez E, Gouraud H, Naudet F, Gross C, Krumholz H, Ross J . Characteristics of available studies and dissemination of research using major clinical data sharing platforms. Clin Trials. 2021; 18(6):657-666. PMC: 8595516. DOI: 10.1177/17407745211038524. View

13.

Danchev V, Min Y, Borghi J, Baiocchi M, Ioannidis J . Evaluation of Data Sharing After Implementation of the International Committee of Medical Journal Editors Data Sharing Statement Requirement. JAMA Netw Open. 2021; 4(1):e2033972. PMC: 7844597. DOI: 10.1001/jamanetworkopen.2020.33972. View

14.

Lewandowsky S, Bishop D . Research integrity: Don't let transparency damage science. Nature. 2016; 529(7587):459-61. DOI: 10.1038/529459a. View

15.

Naudet F, Sakarovitch C, Janiaud P, Cristea I, Fanelli D, Moher D . Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: survey of studies published in and . BMJ. 2018; 360:k400. PMC: 5809812. DOI: 10.1136/bmj.k400. View

16.

Ross M, Iguchi M, Panicker S . Ethical aspects of data sharing and research participant protections. Am Psychol. 2018; 73(2):138-145. DOI: 10.1037/amp0000240. View

17.

Gilmore R, Lorenzo Kennedy J, Adolph K . Practical Solutions for Sharing Data and Materials From Psychological Research. Adv Methods Pract Psychol Sci. 2019; 1(1):121-130. PMC: 6544443. DOI: 10.1177/2515245917746500. View

18.

Minocher R, Atmaca S, Bavero C, McElreath R, Beheim B . Estimating the reproducibility of social learning research published between 1955 and 2018. R Soc Open Sci. 2021; 8(9):210450. PMC: 8441137. DOI: 10.1098/rsos.210450. View

19.

Siebert M, Gaba J, Renault A, Laviolle B, Locher C, Moher D . Data-sharing and re-analysis for main studies assessed by the European Medicines Agency-a cross-sectional study on European Public Assessment Reports. BMC Med. 2022; 20(1):177. PMC: 9119701. DOI: 10.1186/s12916-022-02377-2. View

20.

Doshi P, Goodman S, Ioannidis J . Raw data from clinical trials: within reach?. Trends Pharmacol Sci. 2013; 34(12):645-7. DOI: 10.1016/j.tips.2013.10.006. View