The Impact of Image Acquisition Parameters and ComBat Harmonization on the Predictive Performance of Radiomics: A Renal Cell Carcinoma Model

Overview

Journal Appl Sci (Basel)

Date 2023 Apr 24

PMID 37091743

Authors

Abdalla Ibrahim

Lin Lu

Hao Yang

Oguz Akin

Lawrence H Schwartz

Binsheng Zhao

Affiliations

Soon will be listed here.

Abstract

Radiomics, one of the potential methods for developing clinical biomarker, is one of the exponentially growing research fields. In addition to its potential, several limitations have been identified in this field, and most importantly the effects of variations in imaging parameters on radiomic features (RFs). In this study, we investigate the potential of RFs to predict overall survival in patients with clear cell renal cell carcinoma, as well as the impact of ComBat harmonization on the performance of RF models. We assessed the robustness of the results by performing the analyses a thousand times. Publicly available CT scans of 179 patients were retrospectively collected and analyzed. The scans were acquired using different imaging vendors and parameters in different medical centers. The performance was calculated by averaging the metrics over all runs. On average, the clinical model significantly outperformed the radiomic models. The use of ComBat harmonization, on average, did not significantly improve the performance of radiomic models. Hence, the variability in image acquisition and reconstruction parameters significantly affect the performance of radiomic models. The development of radiomic specific harmonization techniques remain a necessity for the advancement of the field.

Citing Articles

Myocardial perfusion SPECT radiomic features reproducibility assessment: Impact of image reconstruction and harmonization.

Gharibi O, Hajianfar G, Sabouri M, Mohebi M, Bagheri S, Arian F Med Phys. 2024; 52(2):965-977.

PMID: 39470363 PMC: 11788242. DOI: 10.1002/mp.17490.

Differential Radiomics-Based Signature Predicts Lung Cancer Risk Accounting for Imaging Parameters in NLST Cohort.

Ebrahimpour L, Despres P, Manem V Cancer Med. 2024; 13(20):e70359.

PMID: 39463128 PMC: 11513548. DOI: 10.1002/cam4.70359.

The reproducibility and predictivity of radiomic features extracted from dynamic contrast-enhanced computed tomography of hepatocellular carcinoma.

Ibrahim A, Guha S, Lu L, Geng P, Wu Q, Chou Y PLoS One. 2024; 19(9):e0310486.

PMID: 39269960 PMC: 11398651. DOI: 10.1371/journal.pone.0310486.

Impact of Preprocessing Parameters in Medical Imaging-Based Radiomic Studies: A Systematic Review.

Trojani V, Bassi M, Verzellesi L, Bertolini M Cancers (Basel). 2024; 16(15).

PMID: 39123396 PMC: 11311340. DOI: 10.3390/cancers16152668.

Machine learning-based identification of contrast-enhancement phase of computed tomography scans.

Guha S, Ibrahim A, Wu Q, Geng P, Chou Y, Yang H PLoS One. 2024; 19(2):e0294581.

PMID: 38306329 PMC: 10836663. DOI: 10.1371/journal.pone.0294581.

References

Traverso A, Kazmierski M, Shi Z, Kalendralis P, Welch M, Dahl Nissen H . Stability of radiomic features of apparent diffusion coefficient (ADC) maps for locally advanced rectal cancer in response to image pre-processing. Phys Med. 2019; 61:44-51. DOI: 10.1016/j.ejmp.2019.04.009. View

Refaee T, Salahuddin Z, Widaatalla Y, Primakov S, Woodruff H, Hustinx R . CT Reconstruction Kernels and the Effect of Pre- and Post-Processing on the Reproducibility of Handcrafted Radiomic Features. J Pers Med. 2022; 12(4). PMC: 9030848. DOI: 10.3390/jpm12040553. View

Fortin J, Parker D, Tunc B, Watanabe T, Elliott M, Ruparel K . Harmonization of multi-site diffusion tensor imaging data. Neuroimage. 2017; 161:149-170. PMC: 5736019. DOI: 10.1016/j.neuroimage.2017.08.047. View

Shafiq-Ul-Hassan M, Zhang G, Latifi K, Ullah G, Hunt D, Balagurunathan Y . Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels. Med Phys. 2017; 44(3):1050-1062. PMC: 5462462. DOI: 10.1002/mp.12123. View

Zhao B, Tan Y, Tsai W, Qi J, Xie C, Lu L . Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep. 2016; 6:23428. PMC: 4806325. DOI: 10.1038/srep23428. View

Tharmalingam H, Tsang Y, Alonzi R, Beasley W, Taylor N, McWilliam A . Changes in Magnetic Resonance Imaging Radiomic Features in Response to Androgen Deprivation Therapy in Patients with Intermediate- and High-risk Prostate Cancer. Clin Oncol (R Coll Radiol). 2022; 34(6):e246-e253. DOI: 10.1016/j.clon.2021.12.020. View

Ahmed F, Akin O, Shaish H, Luk L, Guo X, Yang H . Nonenhancing Component of Clear Cell Renal Cell Carcinoma on Computed Tomography Correlates With Tumor Necrosis and Stage and Serves as a Size-Independent Prognostic Biomarker. J Comput Assist Tomogr. 2019; 43(4):628-633. PMC: 6629492. DOI: 10.1097/RCT.0000000000000877. View

Ibrahim A, Refaee T, Primakov S, Barufaldi B, Acciavatti R, Granzier R . The Effects of In-Plane Spatial Resolution on CT-Based Radiomic Features' Stability with and without ComBat Harmonization. Cancers (Basel). 2021; 13(8). PMC: 8103509. DOI: 10.3390/cancers13081848. View

Schwier M, van Griethuysen J, Vangel M, Pieper S, Peled S, Tempany C . Repeatability of Multiparametric Prostate MRI Radiomics Features. Sci Rep. 2019; 9(1):9441. PMC: 6602944. DOI: 10.1038/s41598-019-45766-z. View

10.

E L, Lu L, Li L, Yang H, Schwartz L, Zhao B . Radiomics for Classification of Lung Cancer Histological Subtypes Based on Nonenhanced Computed Tomography. Acad Radiol. 2018; 26(9):1245-1252. DOI: 10.1016/j.acra.2018.10.013. View

11.

He L, Huang Y, Ma Z, Liang C, Liang C, Liu Z . Effects of contrast-enhancement, reconstruction slice thickness and convolution kernel on the diagnostic performance of radiomics signature in solitary pulmonary nodule. Sci Rep. 2016; 6:34921. PMC: 5056507. DOI: 10.1038/srep34921. View

12.

Granzier R, Ibrahim A, Primakov S, Samiei S, van Nijnatten T, de Boer M . MRI-Based Radiomics Analysis for the Pretreatment Prediction of Pathologic Complete Tumor Response to Neoadjuvant Systemic Therapy in Breast Cancer Patients: A Multicenter Study. Cancers (Basel). 2021; 13(10). PMC: 8157878. DOI: 10.3390/cancers13102447. View

13.

Zigeuner R, Hutterer G, Chromecki T, Imamovic A, Kampel-Kettner K, Rehak P . External validation of the Mayo Clinic stage, size, grade, and necrosis (SSIGN) score for clear-cell renal cell carcinoma in a single European centre applying routine pathology. Eur Urol. 2008; 57(1):102-9. DOI: 10.1016/j.eururo.2008.11.033. View

14.

Nazari M, Shiri I, Zaidi H . Radiomics-based machine learning model to predict risk of death within 5-years in clear cell renal cell carcinoma patients. Comput Biol Med. 2020; 129:104135. DOI: 10.1016/j.compbiomed.2020.104135. View

15.

Xu Y, Shu Z, Song G, Liu Y, Pang P, Wen X . The Role of Preoperative Computed Tomography Radiomics in Distinguishing Benign and Malignant Tumors of the Parotid Gland. Front Oncol. 2021; 11:634452. PMC: 7988088. DOI: 10.3389/fonc.2021.634452. View

16.

Larue R, van Timmeren J, de Jong E, Feliciani G, Leijenaar R, Schreurs W . Influence of gray level discretization on radiomic feature stability for different CT scanners, tube currents and slice thicknesses: a comprehensive phantom study. Acta Oncol. 2017; 56(11):1544-1553. DOI: 10.1080/0284186X.2017.1351624. View

17.

Li Q, Bai H, Chen Y, Sun Q, Liu L, Zhou S . A Fully-Automatic Multiparametric Radiomics Model: Towards Reproducible and Prognostic Imaging Signature for Prediction of Overall Survival in Glioblastoma Multiforme. Sci Rep. 2017; 7(1):14331. PMC: 5662697. DOI: 10.1038/s41598-017-14753-7. View

18.

Meyer M, Ronald J, Vernuccio F, Nelson R, Ramirez-Giraldo J, Solomon J . Reproducibility of CT Radiomic Features within the Same Patient: Influence of Radiation Dose and CT Reconstruction Settings. Radiology. 2019; 293(3):583-591. PMC: 10860741. DOI: 10.1148/radiol.2019190928. View

19.

Yamashita R, Perrin T, Chakraborty J, Chou J, Horvat N, Koszalka M . Radiomic feature reproducibility in contrast-enhanced CT of the pancreas is affected by variabilities in scan parameters and manual segmentation. Eur Radiol. 2019; 30(1):195-205. PMC: 7127865. DOI: 10.1007/s00330-019-06381-8. View

20.

Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P . The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013; 26(6):1045-57. PMC: 3824915. DOI: 10.1007/s10278-013-9622-7. View