Rate and Success of Study Replication in Ecology and Evolution

Overview

Journal PeerJ

Specialties Biology
Environmental Health
General Medicine

Date 2019 Oct 1

PMID 31565572

Citations 12

Authors

Clint D Kelly

Affiliations

Soon will be listed here.

Abstract

The recent replication crisis has caused several scientific disciplines to self-reflect on the frequency with which they replicate previously published studies and to assess their success in such endeavours. The rate of replication, however, has yet to be assessed for ecology and evolution. Here, I survey the open-access ecology and evolution literature to determine how often ecologists and evolutionary biologists replicate, or at least claim to replicate, previously published studies. I found that approximately 0.023% of ecology and evolution studies are described by their authors as replications. Two of the 11 original-replication study pairs provided sufficient statistical detail for three effects so as to permit a formal analysis of replication success. Replicating authors correctly concluded that they replicated an original effect in two cases; in the third case, my analysis suggests that the finding by the replicating authors was consistent with the original finding, contrary the conclusion of "replication failure" by the authors.

Citing Articles

Predation affects the evolution of sex-specific longevity.

Pennell T, Katsuki M, Archer C, Sharma M, Okada K, Hosken D Biol Lett. 2024; 20(11):20240451.

PMID: 39535110 PMC: 11558850. DOI: 10.1098/rsbl.2024.0451.

A large-scale in silico replication of ecological and evolutionary studies.

Yang Y, van Zwet E, Ignatiadis N, Nakagawa S Nat Ecol Evol. 2024; 8(12):2179-2183.

PMID: 39327468 PMC: 11618063. DOI: 10.1038/s41559-024-02530-5.

Computationally reproducing results from meta-analyses in ecology and evolutionary biology using shared code and data.

Kambouris S, Wilkinson D, Smith E, Fidler F PLoS One. 2024; 19(3):e0300333.

PMID: 38478503 PMC: 10936784. DOI: 10.1371/journal.pone.0300333.

Computational reproducibility of Jupyter notebooks from biomedical publications.

Samuel S, Mietchen D Gigascience. 2024; 13.

PMID: 38206590 PMC: 10783158. DOI: 10.1093/gigascience/giad113.

Landscape-scale mapping of soil fungal distribution: proposing a new NGS-based approach.

Janowski D, Leski T Sci Rep. 2023; 13(1):10280.

PMID: 37355666 PMC: 10290699. DOI: 10.1038/s41598-023-37538-7.

References

Muller C, Riemer S, Viranyi Z, Huber L, Range F . Dogs learn to solve the support problem based on perceptual cues. Anim Cogn. 2014; 17(5):1071-80. PMC: 4138433. DOI: 10.1007/s10071-014-0739-y. View

Zwaan R, Etz A, Lucas R, Donnellan M . Making replication mainstream. Behav Brain Sci. 2017; 41:e120. DOI: 10.1017/S0140525X17001972. View

. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. 2015; 349(6251):aac4716. DOI: 10.1126/science.aac4716. View

Moller A, Cuervo J . Sexual selection, germline mutation rate and sperm competition. BMC Evol Biol. 2003; 3:6. PMC: 156621. DOI: 10.1186/1471-2148-3-6. View

Begley C, Ellis L . Drug development: Raise standards for preclinical cancer research. Nature. 2012; 483(7391):531-3. DOI: 10.1038/483531a. View

Bentosela M, Jakovcevic A, Elgier A, Mustaca A, Papini M . Incentive contrast in domestic dogs (Canis familiaris). J Comp Psychol. 2009; 123(2):125-30. DOI: 10.1037/a0013340. View

Van Oystaeyen A, Oliveira R, Holman L, van Zweden J, Romero C, Oi C . Conserved class of queen pheromones stops social insect workers from reproducing. Science. 2014; 343(6168):287-90. DOI: 10.1126/science.1244899. View

Ringler E, Pasukonis A, Hodl W, Ringler M . Tadpole transport logistics in a Neotropical poison frog: indications for strategic planning and adaptive plasticity in anuran parental care. Front Zool. 2013; 10(1):67. PMC: 3828580. DOI: 10.1186/1742-9994-10-67. View

Amos W . Sexual selection does not influence minisatellite mutation rate. BMC Evol Biol. 2009; 9:5. PMC: 2636768. DOI: 10.1186/1471-2148-9-5. View

10.

Burks K, Miko I, Deans A . Dendrocerus mexicali (Hymenoptera, Ceraphronoidea, Megaspilidae): Novel antennal morphology, first description of female, and expansion of known range into the U.S. Zookeys. 2016; (569):53-69. PMC: 4829679. DOI: 10.3897/zookeys.569.6629. View

11.

Ramirez E, Marin G, Mpodozis J, Letelier J . Extracellular recordings reveal absence of magneto sensitive units in the avian optic tectum. J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 2014; 200(12):983-96. PMC: 4237910. DOI: 10.1007/s00359-014-0947-6. View

12.

Head M, Holman L, Lanfear R, Kahn A, Jennions M . The extent and consequences of p-hacking in science. PLoS Biol. 2015; 13(3):e1002106. PMC: 4359000. DOI: 10.1371/journal.pbio.1002106. View

13.

Jennings J, Snook R, Hoikkala A . Reproductive isolation among allopatric Drosophila montana populations. Evolution. 2014; 68(11):3095-108. DOI: 10.1111/evo.12535. View

14.

Pasukonis A, Trenkwalder K, Ringler M, Ringler E, Mangione R, Steininger J . The significance of spatial memory for water finding in a tadpole-transporting frog. Anim Behav. 2017; 116:89-98. PMC: 5321284. DOI: 10.1016/j.anbehav.2016.02.023. View

15.

Ioannidis J . Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005; 294(2):218-28. DOI: 10.1001/jama.294.2.218. View

16.

Semm P, Demaine C . Neurophysiological properties of magnetic cells in the pigeon's visual system. J Comp Physiol A. 1986; 159(5):619-25. DOI: 10.1007/BF00612035. View

17.

Range F, Hentrup M, Viranyi Z . Dogs are able to solve a means-end task. Anim Cogn. 2011; 14(4):575-83. PMC: 3947724. DOI: 10.1007/s10071-011-0394-5. View

18.

Simonsohn U . Small telescopes: detectability and the evaluation of replication results. Psychol Sci. 2015; 26(5):559-69. DOI: 10.1177/0956797614567341. View

19.

Steiner S, Kropf C, Graber W, Nentwig W, Klopfstein S . Antennal courtship and functional morphology of tyloids in the parasitoid wasp Syrphoctonus tarsatorius (Hymenoptera: Ichneumonidae: Diplazontinae). Arthropod Struct Dev. 2009; 39(1):33-40. DOI: 10.1016/j.asd.2009.10.001. View

20.

Makel M, Plucker J, Hegarty B . Replications in Psychology Research: How Often Do They Really Occur?. Perspect Psychol Sci. 2015; 7(6):537-42. DOI: 10.1177/1745691612460688. View