An Alternative to Null-hypothesis Significance Tests

Overview

Journal Psychol Sci

Specialty Psychology

Date 2005 May 5

PMID 15869691

Citations 88

Authors

Peter R Killeen

Affiliations

Soon will be listed here.

Abstract

The statistic p(rep) estimates the probability of replicating an effect. It captures traditional publication criteria for signal-to-noise ratio, while avoiding parametric inference and the resulting Bayesian dilemma. In concert with effect size and replication intervals, p(rep) provides all of the information now used in evaluating research, while avoiding many of the pitfalls of traditional statistical inference.

Citing Articles

The effect of different parenting styles on the child behavior during the dental visit: observational longitudinal study.

Henedy S, Khalil A, Mahmoud S, El-Habashy L BMC Oral Health. 2025; 25(1):342.

PMID: 40045321 PMC: 11883977. DOI: 10.1186/s12903-025-05659-2.

Differences in lumbar spine intradiscal pressure between standing and sitting postures: a comprehensive literature review.

Roman-Liu D, Kaminska J, Tokarski T PeerJ. 2023; 11:e16176.

PMID: 37872945 PMC: 10590571. DOI: 10.7717/peerj.16176.

Raidionics: an open software for pre- and postoperative central nervous system tumor segmentation and standardized reporting.

Bouget D, Alsinan D, Gaitan V, Holden Helland R, Pedersen A, Solheim O Sci Rep. 2023; 13(1):15570.

PMID: 37730820 PMC: 10511510. DOI: 10.1038/s41598-023-42048-7.

Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?.

Ekkekakis P, Swinton P, Tiller N Sports Med. 2023; 53(10):1865-1890.

PMID: 37561389 DOI: 10.1007/s40279-023-01880-7.

Meningioma Segmentation in T1-Weighted MRI Leveraging Global Context and Attention Mechanisms.

Bouget D, Pedersen A, Hosainey S, Solheim O, Reinertsen I Front Radiol. 2023; 1:711514.

PMID: 37492175 PMC: 10365121. DOI: 10.3389/fradi.2021.711514.

References

Moyer C, Rounds J, Hannum J . A meta-analysis of massage therapy research. Psychol Bull. 2004; 130(1):3-18. DOI: 10.1037/0033-2909.130.1.3. View

Rosenthal R, Rubin D . r equivalent: A simple effect size indicator. Psychol Methods. 2003; 8(4):492-496. DOI: 10.1037/1082-989X.8.4.492. View

Lorber M . Psychophysiology of aggression, psychopathy, and conduct problems: a meta-analysis. Psychol Bull. 2004; 130(4):531-52. DOI: 10.1037/0033-2909.130.4.531. View

Mosteller F, Colditz G . Understanding research synthesis (meta-analysis). Annu Rev Public Health. 1996; 17:1-23. DOI: 10.1146/annurev.pu.17.050196.000245. View

GREENWALD A, Gonzalez R, Harris R, GUTHRIE D . Effect sizes and p values: what should be reported and what should be replicated?. Psychophysiology. 1996; 33(2):175-83. DOI: 10.1111/j.1469-8986.1996.tb02121.x. View

Van Den Noortgate W, Onghena P . Estimating the mean effect size in meta-analysis: bias, precision, and mean squared error of different weighting methods. Behav Res Methods Instrum Comput. 2004; 35(4):504-11. DOI: 10.3758/bf03195529. View

Trafimow D . Hypothesis testing and theory evaluation at the boundaries: surprising insights from Bayes's theorem. Psychol Rev. 2003; 110(3):526-35. DOI: 10.1037/0033-295x.110.3.526. View

Eagly A, Johannesen-Schmidt M, van Engen M . Transformational, transactional, and laissez-faire leadership styles: a meta-analysis comparing women and men. Psychol Bull. 2003; 129(4):569-91. DOI: 10.1037/0033-2909.129.4.569. View

GRISSOM R, Kim J . Review of assumptions and problems in the appropriate conceptualization of effect size. Psychol Methods. 2001; 6(2):135-46. DOI: 10.1037/1082-989x.6.2.135. View

10.

Nickerson R . Null hypothesis significance testing: a review of an old and continuing controversy. Psychol Methods. 2000; 5(2):241-301. DOI: 10.1037/1082-989x.5.2.241. View

11.

Krueger J . Null hypothesis significance testing. On the survival of a flawed method. Am Psychol. 2001; 56(1):16-26. DOI: 10.1037/0003-066x.56.1.16. View