Alpha 2.0
Login Register
» Articles » PMID: 17484431

Probability As Certainty: Dichotomous Thinking and the Misuse of P Values

Overview
Journal Psychon Bull Rev
Specialty Psychology
Date 2007 May 9
PMID 17484431
Citations 23
Authors
Rink Hoekstra
Sue Finch
Henk A L Kiers
Addie Johnson
Affiliations
Soon will be listed here.
Abstract

Significance testing is widely used and often criticized. The Task Force on Statistical Inference of the American Psychological Association (TFSI, APA; Wilkinson & TFSI, 1999) addressed the use of significance testing and made recommendations that were incorporated in the fifth edition of the APA Publication Manual (APA, 2001). They emphasized the interpretation of significance testing and the importance of reporting confidence intervals and effect sizes. We examined whether 286 Psychonomic Bulletin & Review articles submitted before and after the publication of the TFSI recommendations by APA complied with these recommendations. Interpretation errors when using significance testing were still made frequently, and the new prescriptions were not yet followed on a large scale. Changing the practice of reporting statistics seems doomed to be a slow process.

Citing Articles

More similarity than difference: comparison of within- and between-sex variance in early adolescent brain structure.

Torgerson C, Bottenhorn K, Ahmadi H, Choupan J, Herting M bioRxiv. 2024; .

PMID: 39229144 PMC: 11370326. DOI: 10.1101/2024.08.15.608129.

Meta-analysis indicates better climate adaptation and mitigation performance of hybrid engineering-natural coastal defence measures.

Huynh L, Su J, Wang Q, Stringer L, Switzer A, Gasparatos A Nat Commun. 2024; 15(1):2870.

PMID: 38594246 PMC: 11004181. DOI: 10.1038/s41467-024-46970-w.

Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?.

Ekkekakis P, Swinton P, Tiller N Sports Med. 2023; 53(10):1865-1890.

PMID: 37561389 DOI: 10.1007/s40279-023-01880-7.

Verifying the accuracy of statistical significance testing in Campbell Collaboration systematic reviews through the use of the R package .

Polanin J, Nuijten M Campbell Syst Rev. 2023; 14(1):1-36.

PMID: 37131381 PMC: 8428001. DOI: 10.4073/csrm.2018.1.

Reporting and interpreting non-significant results in animal cognition research.

Farrar B, Vernouillet A, Garcia-Pelegrin E, Legg E, Brecht K, Lambert P PeerJ. 2023; 11:e14963.

PMID: 36919170 PMC: 10008313. DOI: 10.7717/peerj.14963.

References
1.
Tryon W . Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an integrated alternative method of conducting null hypothesis statistical tests. Psychol Methods. 2002; 6(4):371-86. View
2.
Rozeboom W . The fallacy of the null-hypothesis significance test. Psychol Bull. 1960; 57:416-28. DOI: 10.1037/h0042040. View
3.
Masson M . Using confidence intervals for graphically based data interpretation. Can J Exp Psychol. 2003; 57(3):203-20. DOI: 10.1037/h0087426. View
4.
Bakan D . The test of significance in psychological research. Psychol Bull. 1966; 66(6):423-37. DOI: 10.1037/h0020412. View