Multimodal Data Integration for Predicting Progression Risk in Castration-resistant Prostate Cancer Using Deep Learning: a Multicenter Retrospective Study

Overview

Journal Front Oncol

Specialty Oncology

Date 2024 Mar 29

PMID 38549937

Authors

Chuan Zhou

Yun-Feng Zhang

Sheng Guo

Yu-Qian Huang

Xiao-Ni Qiao

Rong Wang

Lian-Ping Zhao

De-Hui Chang

Li-Ming Zhao

Ming-Xu Da

Feng-Hai Zhou

Affiliations

Soon will be listed here.

Abstract

Purpose: Patients with advanced prostate cancer (PCa) often develop castration-resistant PCa (CRPC) with poor prognosis. Prognostic information obtained from multiparametric magnetic resonance imaging (mpMRI) and histopathology specimens can be effectively utilized through artificial intelligence (AI) techniques. The objective of this study is to construct an AI-based CRPC progress prediction model by integrating multimodal data.

Methods And Materials: Data from 399 patients diagnosed with PCa at three medical centers between January 2018 and January 2021 were collected retrospectively. We delineated regions of interest (ROIs) from 3 MRI sequences viz, T2WI, DWI, and ADC and utilized a cropping tool to extract the largest section of each ROI. We selected representative pathological hematoxylin and eosin (H&E) slides for deep-learning model training. A joint combined model nomogram was constructed. ROC curves and calibration curves were plotted to assess the predictive performance and goodness of fit of the model. We generated decision curve analysis (DCA) curves and Kaplan-Meier (KM) survival curves to evaluate the clinical net benefit of the model and its association with progression-free survival (PFS).

Results: The AUC of the machine learning (ML) model was 0.755. The best deep learning (DL) model for radiomics and pathomics was the ResNet-50 model, with an AUC of 0.768 and 0.752, respectively. The nomogram graph showed that DL model contributed the most, and the AUC for the combined model was 0.86. The calibration curves and DCA indicate that the combined model had a good calibration ability and net clinical benefit. The KM curve indicated that the model integrating multimodal data can guide patient prognosis and management strategies.

Conclusion: The integration of multimodal data effectively improves the prediction of risk for the progression of PCa to CRPC.

Citing Articles

Harnessing machine learning to predict prostate cancer survival: a review.

Bang S, Ahn Y, Koo K Front Oncol. 2025; 14:1502629.

PMID: 39868377 PMC: 11757104. DOI: 10.3389/fonc.2024.1502629.

References

Massanova M, Vere R, Robertson S, Crocetto F, Barone B, Dutto L . Clinical and prostate multiparametric magnetic resonance imaging findings as predictors of general and clinically significant prostate cancer risk: A retrospective single-center study. Curr Urol. 2023; 17(3):147-152. PMC: 10337816. DOI: 10.1097/CU9.0000000000000173. View

Pernigoni N, Zagato E, Calcinotto A, Troiani M, Mestre R, Cali B . Commensal bacteria promote endocrine resistance in prostate cancer through androgen biosynthesis. Science. 2021; 374(6564):216-224. DOI: 10.1126/science.abf8403. View

Chen R, Lu M, Wang J, Williamson D, Rodig S, Lindeman N . Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis. IEEE Trans Med Imaging. 2020; 41(4):757-770. PMC: 10339462. DOI: 10.1109/TMI.2020.3021387. View

Reda I, Khalil A, Elmogy M, Abou El-Fetouh A, Shalaby A, Abou El-Ghar M . Deep Learning Role in Early Diagnosis of Prostate Cancer. Technol Cancer Res Treat. 2018; 17:1533034618775530. PMC: 5972199. DOI: 10.1177/1533034618775530. View

Harris W, Mostaghel E, Nelson P, Montgomery B . Androgen deprivation therapy: progress in understanding mechanisms of resistance and optimizing androgen depletion. Nat Clin Pract Urol. 2009; 6(2):76-85. PMC: 2981403. DOI: 10.1038/ncpuro1296. View

Khurana N, Kim H, Chandra P, Talwar S, Sharma P, Abdel-Mageed A . Multimodal actions of the phytochemical sulforaphane suppress both AR and AR-V7 in 22Rv1 cells: Advocating a potent pharmaceutical combination against castration-resistant prostate cancer. Oncol Rep. 2017; 38(5):2774-2786. PMC: 5780030. DOI: 10.3892/or.2017.5932. View

Jing L, Tian Y . Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey. IEEE Trans Pattern Anal Mach Intell. 2020; 43(11):4037-4058. DOI: 10.1109/TPAMI.2020.2992393. View

Bera K, Braman N, Gupta A, Velcheti V, Madabhushi A . Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat Rev Clin Oncol. 2021; 19(2):132-146. PMC: 9034765. DOI: 10.1038/s41571-021-00560-7. View

Aerts H, Velazquez E, Leijenaar R, Parmar C, Grossmann P, Carvalho S . Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014; 5:4006. PMC: 4059926. DOI: 10.1038/ncomms5006. View

10.

Bray F, Ferlay J, Soerjomataram I, Siegel R, Torre L, Jemal A . Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018; 68(6):394-424. DOI: 10.3322/caac.21492. View

11.

Barone B, Napolitano L, Calace F, Biondo D, Napodano G, Grillo M . Reliability of Multiparametric Magnetic Resonance Imaging in Patients with a Previous Negative Biopsy: Comparison with Biopsy-Naïve Patients in the Detection of Clinically Significant Prostate Cancer. Diagnostics (Basel). 2023; 13(11). PMC: 10253019. DOI: 10.3390/diagnostics13111939. View

12.

Bi W, Hosny A, Schabath M, Giger M, Birkbak N, Mehrtash A . Artificial intelligence in cancer imaging: Clinical challenges and applications. CA Cancer J Clin. 2019; 69(2):127-157. PMC: 6403009. DOI: 10.3322/caac.21552. View

13.

Nakamura K, Norihisa Y, Ikeda I, Inokuchi H, Aizawa R, Kamoto T . Ten-year outcomes of whole-pelvic intensity-modulated radiation therapy for prostate cancer with regional lymph node metastasis. Cancer Med. 2022; 12(7):7859-7867. PMC: 10134326. DOI: 10.1002/cam4.5554. View

14.

Hu L, Zhou D, Guo X, Xu W, Wei L, Zhao J . Adversarial training for prostate cancer classification using magnetic resonance imaging. Quant Imaging Med Surg. 2022; 12(6):3276-3287. PMC: 9131330. DOI: 10.21037/qims-21-1089. View

15.

van Timmeren J, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B . Radiomics in medical imaging-"how-to" guide and critical reflection. Insights Imaging. 2020; 11(1):91. PMC: 7423816. DOI: 10.1186/s13244-020-00887-2. View

16.

Boehm K, Khosravi P, Vanguri R, Gao J, Shah S . Harnessing multimodal data integration to advance precision oncology. Nat Rev Cancer. 2021; 22(2):114-126. PMC: 8810682. DOI: 10.1038/s41568-021-00408-3. View

17.

Ryan C, Smith M, Fizazi K, Saad F, Mulders P, Sternberg C . Abiraterone acetate plus prednisone versus placebo plus prednisone in chemotherapy-naive men with metastatic castration-resistant prostate cancer (COU-AA-302): final overall survival analysis of a randomised, double-blind, placebo-controlled phase 3.... Lancet Oncol. 2015; 16(2):152-60. DOI: 10.1016/S1470-2045(14)71205-7. View

18.

Cheng Q, Butler W, Zhou Y, Zhang H, Tang L, Perkinson K . Pre-existing Castration-resistant Prostate Cancer-like Cells in Primary Prostate Cancer Promote Resistance to Hormonal Therapy. Eur Urol. 2022; 81(5):446-455. PMC: 9018600. DOI: 10.1016/j.eururo.2021.12.039. View

19.

Wang R, Dai W, Gong J, Huang M, Hu T, Li H . Development of a novel combined nomogram model integrating deep learning-pathomics, radiomics and immunoscore to predict postoperative outcome of colorectal cancer lung metastasis patients. J Hematol Oncol. 2022; 15(1):11. PMC: 8785554. DOI: 10.1186/s13045-022-01225-3. View

20.

Lai Y, Chen W, Hsu T, Lin C, Tsao Y, Wu S . Overall survival prediction of non-small cell lung cancer by integrating microarray and clinical data with deep learning. Sci Rep. 2020; 10(1):4679. PMC: 7069964. DOI: 10.1038/s41598-020-61588-w. View