The Fragility Index: How Robust Are the Outcomes of Head and Neck Cancer Randomised, Controlled Trials?

Overview

Journal J Laryngol Otol

Publisher Cambridge University Press

Specialty Otorhinolaryngology

Date 2023 Oct 5

PMID 37795709

Authors

Neeraj V Suresh

Beatrice C Go

Christian G Fritz

Jacob Harris

Vinayak Ahluwalia

Katherine Xu

Joseph Lu

Karthik Rajasekaran

Affiliations

Soon will be listed here.

Abstract

Background: The fragility index represents the minimum number of patients required to convert an outcome from statistically significant to insignificant. This report assesses the fragility index of head and neck cancer randomised, controlled trials.

Methods: Studies were extracted from PubMed/Medline, Scopus, Embase and Cochrane databases.

Results: Overall, 123 randomised, controlled trials were included. The sample size and fragility index medians (interquartile ranges) were 103 (56-213) and 2 (0-5), respectively. The fragility index exceeded the number of patients lost to follow up in 42.3 per cent ( = 52) of studies. A higher fragility index correlated with higher sample size (r = 0.514, < 0.001), number of events (r = 0.449, < 0.001) and statistical significance via -value (r = -0.367, < 0.001).

Conclusion: Head and neck cancer randomised, controlled trials demonstrated low fragility index values, in which statistically significant results could be nullified by altering the outcomes of just two patients, on average. Future head and neck oncology randomised, controlled trials should report the fragility index in order to provide insight into statistical robustness.

Citing Articles

Beyond the Fragility Index.

Quatto P, Ripamonti E, Marasini D Pharm Stat. 2024; 24(2):e2452.

PMID: 39572892 PMC: 11889990. DOI: 10.1002/pst.2452.

References

Ruzbarsky J, Khormaee S, Rauck R, Warren R . Fragility of randomized clinical trials of treatment of clavicular fractures. J Shoulder Elbow Surg. 2019; 28(3):415-422. DOI: 10.1016/j.jse.2018.11.039. View

Ruzbarsky J, Khormaee S, Daluiski A . The Fragility Index in Hand Surgery Randomized Controlled Trials. J Hand Surg Am. 2018; 44(8):698.e1-698.e7. DOI: 10.1016/j.jhsa.2018.10.005. View

Pijls B . The Table I Fallacy: P Values in Baseline Tables of Randomized Controlled Trials. J Bone Joint Surg Am. 2022; 104(16):e71. DOI: 10.2106/JBJS.21.01166. View

Noel C, McMullen C, Yao C, Monteiro E, Goldstein D, Eskander A . The fragility of statistically significant findings from randomized trials in head and neck surgery. Laryngoscope. 2018; 128(9):2094-2100. DOI: 10.1002/lary.27183. View

Muthu S, Ramakrishnan E . Fragility Analysis of Statistically Significant Outcomes of Randomized Control Trials in Spine Surgery: A Systematic Review. Spine (Phila Pa 1976). 2020; 46(3):198-208. DOI: 10.1097/BRS.0000000000003645. View

Sterne J, Davey Smith G . Sifting the evidence-what's wrong with significance tests?. BMJ. 2001; 322(7280):226-31. PMC: 1119478. DOI: 10.1136/bmj.322.7280.226. View

Mielke D, Rohde V . Randomized controlled trials-a critical re-appraisal. Neurosurg Rev. 2020; 44(4):2085-2089. PMC: 8338869. DOI: 10.1007/s10143-020-01401-4. View

Andrade C . The Use and Limitations of the Fragility Index in the Interpretation of Clinical Trial Findings. J Clin Psychiatry. 2020; 81(2). DOI: 10.4088/JCP.20f13334. View

Go C, Maldonado D, Go B, Annin S, Saks B, Jimenez A . The Fragility Index of Total Hip Arthroplasty Randomized Control Trials: A Systematic Review. J Am Acad Orthop Surg. 2022; 30(9):e741-e750. DOI: 10.5435/JAAOS-D-21-00489. View

10.

Sato K, Toda T, Iwata A . Fragility Index in Randomized Controlled Trials of Ischemic Stroke. J Stroke Cerebrovasc Dis. 2019; 28(5):1290-1294. DOI: 10.1016/j.jstrokecerebrovasdis.2019.01.015. View

11.

Khormaee S, Choe J, Ruzbarsky J, Agarwal K, Blanco J, Doyle S . The Fragility of Statistically Significant Results in Pediatric Orthopaedic Randomized Controlled Trials as Quantified by the Fragility Index: A Systematic Review. J Pediatr Orthop. 2018; 38(8):e418-e423. DOI: 10.1097/BPO.0000000000001201. View

12.

Rosenberg W, Donald A . Evidence based medicine: an approach to clinical problem-solving. BMJ. 1995; 310(6987):1122-6. PMC: 2549505. DOI: 10.1136/bmj.310.6987.1122. View

13.

Herndon C, McCormick K, Gazgalis A, Bixby E, Levitsky M, Neuwirth A . Fragility Index as a Measure of Randomized Clinical Trial Quality in Adult Reconstruction: A Systematic Review. Arthroplast Today. 2021; 11:239-251. PMC: 8517286. DOI: 10.1016/j.artd.2021.08.018. View

14.

Adeeb N, Terrell D, Whipple S, Thakur J, Griessenauer C, Adeeb A . The Reproducibility of Cerebrovascular Randomized Controlled Trials. World Neurosurg. 2020; 140:e46-e52. DOI: 10.1016/j.wneu.2020.04.106. View

15.

Walsh M, Srinathan S, McAuley D, Mrkobrada M, Levine O, Ribic C . The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index. J Clin Epidemiol. 2014; 67(6):622-8. DOI: 10.1016/j.jclinepi.2013.10.019. View

16.

Skinner M, Tritz D, Farahani C, Ross A, Hamilton T, Vassar M . The fragility of statistically significant results in otolaryngology randomized trials. Am J Otolaryngol. 2018; 40(1):61-66. DOI: 10.1016/j.amjoto.2018.10.011. View

17.

Higgins K, Wang J . State of head and neck surgical oncology research--a review and critical appraisal of landmark studies. Head Neck. 2008; 30(12):1636-42. DOI: 10.1002/hed.20863. View

18.

McGiffin D, Cumming G, Myles P . The frequent insignificance of a "significant" p-value. J Card Surg. 2021; 36(11):4322-4331. DOI: 10.1111/jocs.15960. View

19.

Gnech M, Lovatt C, McGrath M, Rickard M, Sanger S, Lorenzo A . Quality of reporting and fragility index for randomized controlled trials in the vesicoureteral reflux literature: where do we stand?. J Pediatr Urol. 2019; 15(3):204-212. DOI: 10.1016/j.jpurol.2019.02.014. View

20.

Lakens D . The Practical Alternative to the Value Is the Correctly Used Value. Perspect Psychol Sci. 2021; 16(3):639-648. PMC: 8114329. DOI: 10.1177/1745691620958012. View