Finding the Right Power Balance: Better Study Design and Collaboration Can Reduce Dependence on Statistical Power
Affiliations
Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result in suboptimal study design because publication biases towards studies with the largest effects can lead to the overestimation of effect sizes. In this Essay, we propose a paradigm shift towards better study designs that focus less on statistical power. We also advocate for (pre)registration and obligatory reporting of all results (regardless of statistical significance), better facilitation of team science and multi-institutional collaboration that incorporates heterogenization, and the use of prospective and living meta-analyses to generate generalizable results. Such changes could make science more effective and, potentially, more equitable, helping to cultivate better collaborations.
Poor hypotheses and research waste in biology: learning from a theory crisis in psychology.
Nakagawa S, Armitage D, Froese T, Yang Y, Lagisz M BMC Biol. 2025; 23(1):33.
PMID: 39901226 PMC: 11792729. DOI: 10.1186/s12915-025-02134-w.
A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.
Vankelecom L, Schacht O, Laroy N, Loeys T, Moerkerke B Psychol Belg. 2025; 65(1):17-37.
PMID: 39802672 PMC: 11720577. DOI: 10.5334/pb.1318.
A large-scale in silico replication of ecological and evolutionary studies.
Yang Y, van Zwet E, Ignatiadis N, Nakagawa S Nat Ecol Evol. 2024; 8(12):2179-2183.
PMID: 39327468 PMC: 11618063. DOI: 10.1038/s41559-024-02530-5.
Franchini M, Mengoli C, Casadevall A, Focosi D Life (Basel). 2024; 14(7).
PMID: 39063547 PMC: 11278192. DOI: 10.3390/life14070792.
Supporting study registration to reduce research waste.
Purgar M, Glasziou P, Klanjscek T, Nakagawa S, Culina A Nat Ecol Evol. 2024; 8(8):1391-1399.
PMID: 38839851 DOI: 10.1038/s41559-024-02433-5.