A Method for Calculating the Fragility Index of Continuous Outcomes
Overview
Affiliations
Objective: Clinicians' overdependence on p-values to determine significance in clinical trials is common yet potentially misleading. The Fragility Index (FI) describes how robust a significant result is by determining the number of events the statistical significance hinges on. However, this concept cannot be applied to nondichotomous variables. We describe a method to calculate a Continuous Fragility Index (CFI) for continuous variables. We further provide a method to estimate CFI when original data is not available.
Study Design And Setting: An iterative substitution algorithm is described to calculate CFI prospectively from data or retrospectively from summary statistics and its response to variations in the data is reported. We then apply this method to a previously published review as a proof-of-concept.
Results: The CFI increases linearly with sample size, logarithmically with mean difference, and decreases exponentially with standard deviation. Forty-eight studies were included of which 30 had significant non-dichotomous outcomes. CFI and FI were uncorrelated and mean CFI was significantly higher than FI (9 vs. 2, P< 0.001).
Conclusion: Our algorithm extends fragility to continuous outcomes, expanding the applications of the fragility concept. The fragility of outcomes within a single study may vary based on variable type and should be evaluated independently.
Singh G, Alexeev S, Haugh P, Halvorson R, Wang D, Pandya N Orthop J Sports Med. 2025; 13(2):23259671241313472.
PMID: 39958698 PMC: 11826875. DOI: 10.1177/23259671241313472.
Zhou X, Ruan W, Zhang G, Liu H, Wang T, Li J Ann Med. 2024; 56(1):2427909.
PMID: 39624960 PMC: 11616752. DOI: 10.1080/07853890.2024.2427909.
Robustness Assessment of Oncology Dose-Finding Trials Using the Modified Fragility Index.
Shi A, Zhou H, Nie L, Lin L, Li H, Chu H Cancers (Basel). 2024; 16(20).
PMID: 39456598 PMC: 11506443. DOI: 10.3390/cancers16203504.
The Statistical Fragility of Lateral Extra-articular Tenodesis Research: A Systematic Review.
Byrne R, Ahn B, Zhao L, Quinn M, Naphade O, Owens B Orthop J Sports Med. 2024; 12(8):23259671241266329.
PMID: 39221044 PMC: 11363240. DOI: 10.1177/23259671241266329.
Al-Asadi M, Sherren M, Khalik H, Leroux T, Ayeni O, Madden K Am J Sports Med. 2024; 52(10):2667-2675.
PMID: 38258495 PMC: 11344964. DOI: 10.1177/03635465231202522.