Inclusion of Effect Size Measures and Clinical Relevance in Research Papers
Authors
Affiliations
Background: There are multiple issues that arise when researchers focus on and only report "statistical significance" of study findings. An important element that is often not included in reports is a discussion of clinical relevance.
Objectives: The authors address issues related to significance, the use of effect sizes, confidence or credible intervals, and the inclusion of clinical relevance in reports of research findings.
Methods: Measures of magnitude, precision, and relevance such as effect sizes, confidence intervals (CIs), and clinically relevant effects are described in detail. In addition, recommendations for reporting and evaluating effect sizes and CIs are included. Example scenarios are presented to illustrate the interplay of statistical significance and clinical relevance.
Results: There are several issues that may arise when significance is the focus of clinical research reporting. One issue is the lack of attention to nonsignificant findings in published works although findings show clinical relevance. Another issue is that significance is interpreted as clinical relevance. As well, clinically relevant results from small-sample studies are often not considered for publication, and thus, findings might not be available for meta-analysis.
Discussion: Findings in research reports should address effect sizes and clinical relevance and significance. Failure to publish clinically relevant effects and CIs may preclude the inclusion of clinically relevant studies in systematic reviews and meta-analyses, thereby limiting the advancement of evidence-based practice. Several accessible resources for researchers to generate, report, and evaluate measures of magnitude, precision, and relevance are included in this article.
Masoumzadeh M, Rahmani V, Sayyah-Melli M, Sani A Eur J Obstet Gynecol Reprod Biol X. 2025; 25:100369.
PMID: 39995616 PMC: 11848489. DOI: 10.1016/j.eurox.2025.100369.
A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research.
Vankelecom L, Schacht O, Laroy N, Loeys T, Moerkerke B Psychol Belg. 2025; 65(1):17-37.
PMID: 39802672 PMC: 11720577. DOI: 10.5334/pb.1318.
De Rubeis G, Alessiani M, Fabiano S, Bertaccini L, Wlderk A, Pezzella F Neuroradiol J. 2024; :19714009241303134.
PMID: 39572204 PMC: 11583170. DOI: 10.1177/19714009241303134.
Davis S, Jaser S, Ivankova N, Rice M J Pediatr Health Care. 2024; 39(1):5-13.
PMID: 39387754 PMC: 11646180. DOI: 10.1016/j.pedhc.2024.08.012.
Nombera-Aznaran N, Guevara-Lazo D, Fernandez-Guzman D, Taype-Rondan A PLoS One. 2024; 19(7):e0306334.
PMID: 38959247 PMC: 11221636. DOI: 10.1371/journal.pone.0306334.