Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power

Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result in suboptimal study design because publication biases towards studies with the largest effects can lead to the overestimation of eff...

Full description

Saved in:
Bibliographic Details
Published in:PLoS biology 2024-01, Vol.22 (1), p.e3002423-e3002423
Main Authors: Nakagawa, Shinichi, Lagisz, Malgorzata, Yang, Yefeng, Drobniak, Szymon M
Format: Article
Language:English
Subjects:
Analysis
Bias
Collaboration
Cooperation
Estimates
Hypotheses
Medical research
Methods
Size determination
Statistical hypothesis testing
Statistical power
Statistics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result in suboptimal study design because publication biases towards studies with the largest effects can lead to the overestimation of effect sizes. In this Essay, we propose a paradigm shift towards better study designs that focus less on statistical power. We also advocate for (pre)registration and obligatory reporting of all results (regardless of statistical significance), better facilitation of team science and multi-institutional collaboration that incorporates heterogenization, and the use of prospective and living meta-analyses to generate generalizable results. Such changes could make science more effective and, potentially, more equitable, helping to cultivate better collaborations.
ISSN:1545-7885
1544-9173
1545-7885
DOI:10.1371/journal.pbio.3002423