» Articles » PMID: 38190355

Finding the Right Power Balance: Better Study Design and Collaboration Can Reduce Dependence on Statistical Power

Overview
Journal PLoS Biol
Specialty Biology
Date 2024 Jan 8
PMID 38190355
Authors
Affiliations
Soon will be listed here.
Abstract

Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result in suboptimal study design because publication biases towards studies with the largest effects can lead to the overestimation of effect sizes. In this Essay, we propose a paradigm shift towards better study designs that focus less on statistical power. We also advocate for (pre)registration and obligatory reporting of all results (regardless of statistical significance), better facilitation of team science and multi-institutional collaboration that incorporates heterogenization, and the use of prospective and living meta-analyses to generate generalizable results. Such changes could make science more effective and, potentially, more equitable, helping to cultivate better collaborations.

Citing Articles

Poor hypotheses and research waste in biology: learning from a theory crisis in psychology.

Nakagawa S, Armitage D, Froese T, Yang Y, Lagisz M BMC Biol. 2025; 23(1):33.

PMID: 39901226 PMC: 11792729. DOI: 10.1186/s12915-025-02134-w.


A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.

Vankelecom L, Schacht O, Laroy N, Loeys T, Moerkerke B Psychol Belg. 2025; 65(1):17-37.

PMID: 39802672 PMC: 11720577. DOI: 10.5334/pb.1318.


A large-scale in silico replication of ecological and evolutionary studies.

Yang Y, van Zwet E, Ignatiadis N, Nakagawa S Nat Ecol Evol. 2024; 8(12):2179-2183.

PMID: 39327468 PMC: 11618063. DOI: 10.1038/s41559-024-02530-5.


Exploring Study Design Foibles in Randomized Controlled Trials on Convalescent Plasma in Hospitalized COVID-19 Patients.

Franchini M, Mengoli C, Casadevall A, Focosi D Life (Basel). 2024; 14(7).

PMID: 39063547 PMC: 11278192. DOI: 10.3390/life14070792.


Supporting study registration to reduce research waste.

Purgar M, Glasziou P, Klanjscek T, Nakagawa S, Culina A Nat Ecol Evol. 2024; 8(8):1391-1399.

PMID: 38839851 DOI: 10.1038/s41559-024-02433-5.


References
1.
Voelkl B, Vogt L, Sena E, Wurbel H . Reproducibility of preclinical animal research improves with heterogeneity of study samples. PLoS Biol. 2018; 16(2):e2003693. PMC: 5823461. DOI: 10.1371/journal.pbio.2003693. View

2.
Arnqvist G . Mixed Models Offer No Freedom from Degrees of Freedom. Trends Ecol Evol. 2020; 35(4):329-335. DOI: 10.1016/j.tree.2019.12.004. View

3.
Jeffers M, MacLellan A, Avey M, Menon J, Sunohara-Neilson J, Fergusson D . A call to implement preclinical study registration in animal ethics review. PLoS Biol. 2023; 21(10):e3002293. PMC: 10553358. DOI: 10.1371/journal.pbio.3002293. View

4.
Davies S, Putnam H, Ainsworth T, Baum J, Bove C, Crosby S . Promoting inclusive metrics of success and impact to dismantle a discriminatory reward system in science. PLoS Biol. 2021; 19(6):e3001282. PMC: 8205123. DOI: 10.1371/journal.pbio.3001282. View

5.
Culina A, Adriaensen F, Bailey L, Burgess M, Charmantier A, Cole E . Connecting the data landscape of long-term ecological studies: The SPI-Birds data hub. J Anim Ecol. 2020; 90(9):2147-2160. PMC: 8518542. DOI: 10.1111/1365-2656.13388. View