Deep Learning-based Prediction of Molecular Cancer Biomarkers from Tissue Slides: A New Tool for Precision Oncology

Overview

Journal Clin Mol Hepatol

Specialty Gastroenterology

Date 2022 Apr 21

PMID 35443570

Authors

Sung Hak Lee

Hyun-Jong Jang

Affiliations

Soon will be listed here.

Abstract

Molecular tests are necessary to stratify cancer patients for targeted therapy. However, high cost and technical barriers limit the application of these tests, hindering optimal treatment. Recently, deep learning (DL) has been applied to predict molecular test results from digitized images of tissue slides. Furthermore, treatment response and prognosis can be predicted from tissue slides using DL. In this review, we summarized DL-based studies regarding the prediction of genetic mutation, microsatellite instability, tumor mutational burden, molecular subtypes, gene expression, treatment response, and prognosis directly from hematoxylin- and eosin-stained tissue slides. Although performance needs to be improved, these studies clearly demonstrated the feasibility of DL-based prediction of key molecular features in cancer tissues. With the accumulation of data and technical advances, the performance of the DL system could be improved in the near future. Therefore, we expect that DL could provide cost- and time-effective alternative tools for patient stratification in the era of precision oncology.

Citing Articles

Deep learning-based image analysis in muscle histopathology using photo-realistic synthetic data.

Mill L, Aust O, Ackermann J, Burger P, Pascual M, Palumbo-Zerr K Commun Med (Lond). 2025; 5(1):64.

PMID: 40050400 PMC: 11885816. DOI: 10.1038/s43856-025-00777-y.

Development and validation of a prognostic nomogram including inflammatory indicators for overall survival in hepatocellular carcinoma patients treated primarily with surgery or loco-regional therapy: A single-center retrospective study.

Wang X, Xu J, Jia Z, Sun G Medicine (Baltimore). 2024; 103(50):e40889.

PMID: 39686498 PMC: 11651482. DOI: 10.1097/MD.0000000000040889.

Integrating transcriptomic data and digital pathology for NRG-based prediction of prognosis and therapy response in gastric cancer.

Sun Q, Li T, Wei Z, Ye Z, Zhao X, Jing J Ann Med. 2024; 56(1):2426758.

PMID: 39527470 PMC: 11556273. DOI: 10.1080/07853890.2024.2426758.

Training immunophenotyping deep learning models with the same-section ground truth cell label derivation method improves virtual staining accuracy.

Azam A, Wee F, Vayrynen J, Yim W, Xue Y, Chua B Front Immunol. 2024; 15:1404640.

PMID: 39007128 PMC: 11239356. DOI: 10.3389/fimmu.2024.1404640.

Correspondence to editorial on "Multiomics profiling of buffy coat and plasma unveils etiology-specific signatures in hepatocellular carcinoma".

Lim S, Cho H Clin Mol Hepatol. 2024; 30(4):1009-1011.

PMID: 38768961 PMC: 11540393. DOI: 10.3350/cmh.2024.0368.

References

Litjens G, Sanchez C, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I . Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016; 6:26286. PMC: 4876324. DOI: 10.1038/srep26286. View

Chen M, Zhang B, Topatana W, Cao J, Zhu H, Juengpanich S . Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning. NPJ Precis Oncol. 2020; 4:14. PMC: 7280520. DOI: 10.1038/s41698-020-0120-3. View

Levy-Jurgenson A, Tekpli X, Kristensen V, Yakhini Z . Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer. Sci Rep. 2020; 10(1):18802. PMC: 7606448. DOI: 10.1038/s41598-020-75708-z. View

Lee J, Kim S, Kim K, Lee H, Kozarewa I, Mortimer P . Tumor Genomic Profiling Guides Patients with Metastatic Gastric Cancer to Targeted Treatment: The VIKTORY Umbrella Trial. Cancer Discov. 2019; 9(10):1388-1405. DOI: 10.1158/2159-8290.CD-19-0442. View

He B, Bergenstrahle L, Stenbeck L, Abid A, Andersson A, Borg A . Integrating spatial gene expression and breast tumour morphology via deep learning. Nat Biomed Eng. 2020; 4(8):827-834. DOI: 10.1038/s41551-020-0578-x. View

Reis-Filho J, Westbury C, Pierga J . The impact of expression profiling on prognostic and predictive testing in breast cancer. J Clin Pathol. 2006; 59(3):225-31. PMC: 1860331. DOI: 10.1136/jcp.2005.028324. View

Costa D, Nguyen K, Cho B, Sequist L, Jackman D, Riely G . Effects of erlotinib in EGFR mutated non-small cell lung cancers with resistance to gefitinib. Clin Cancer Res. 2008; 14(21):7060-7. PMC: 2596582. DOI: 10.1158/1078-0432.CCR-08-1455. View

Wulczyn E, Steiner D, Xu Z, Sadhwani A, Wang H, Flament-Auvigne I . Deep learning-based survival prediction for multiple cancer types using histopathology images. PLoS One. 2020; 15(6):e0233678. PMC: 7299324. DOI: 10.1371/journal.pone.0233678. View

Klempner S, Fabrizio D, Bane S, Reinhart M, Peoples T, Ali S . Tumor Mutational Burden as a Predictive Biomarker for Response to Immune Checkpoint Inhibitors: A Review of Current Evidence. Oncologist. 2019; 25(1):e147-e159. PMC: 6964127. DOI: 10.1634/theoncologist.2019-0244. View

10.

Yamashita R, Long J, Longacre T, Peng L, Berry G, Martin B . Deep learning model for the prediction of microsatellite instability in colorectal cancer: a diagnostic study. Lancet Oncol. 2021; 22(1):132-141. DOI: 10.1016/S1470-2045(20)30535-0. View

11.

Hu F, Zhou Y, Wang Q, Yang Z, Shi Y, Chi Q . Gene Expression Classification of Lung Adenocarcinoma into Molecular Subtypes. IEEE/ACM Trans Comput Biol Bioinform. 2019; 17(4):1187-1197. DOI: 10.1109/TCBB.2019.2905553. View

12.

Tsou P, Wu C . Mapping Driver Mutations to Histopathological Subtypes in Papillary Thyroid Carcinoma: Applying a Deep Convolutional Neural Network. J Clin Med. 2019; 8(10). PMC: 6832421. DOI: 10.3390/jcm8101675. View

13.

Coudray N, Ocampo P, Sakellaropoulos T, Narula N, Snuderl M, Fenyo D . Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018; 24(10):1559-1567. PMC: 9847512. DOI: 10.1038/s41591-018-0177-5. View

14.

Courtiol P, Maussion C, Moarii M, Pronier E, Pilcer S, Sefta M . Deep learning-based classification of mesothelioma improves prediction of patient outcome. Nat Med. 2019; 25(10):1519-1525. DOI: 10.1038/s41591-019-0583-3. View

15.

Tizhoosh H, Pantanowitz L . Artificial Intelligence and Digital Pathology: Challenges and Opportunities. J Pathol Inform. 2019; 9:38. PMC: 6289004. DOI: 10.4103/jpi.jpi_53_18. View

16.

Loeffler C, Bruechle N, Jung M, Seillier L, Rose M, Laleh N . Artificial Intelligence-based Detection of FGFR3 Mutational Status Directly from Routine Histology in Bladder Cancer: A Possible Preselection for Molecular Testing?. Eur Urol Focus. 2021; 8(2):472-479. DOI: 10.1016/j.euf.2021.04.007. View

17.

Noorbakhsh J, Farahmand S, Foroughi Pour A, Namburi S, Caruana D, Rimm D . Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images. Nat Commun. 2020; 11(1):6367. PMC: 7733499. DOI: 10.1038/s41467-020-20030-5. View

18.

Rudin C . Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead. Nat Mach Intell. 2022; 1(5):206-215. PMC: 9122117. DOI: 10.1038/s42256-019-0048-x. View

19.

Sirinukunwattana K, Domingo E, Richman S, Redmond K, Blake A, Verrill C . Image-based consensus molecular subtype (imCMS) classification of colorectal cancer using deep learning. Gut. 2020; 70(3):544-554. PMC: 7873419. DOI: 10.1136/gutjnl-2019-319866. View

20.

Kather J, Heij L, Grabsch H, Loeffler C, Echle A, Muti H . Pan-cancer image-based detection of clinically actionable genetic alterations. Nat Cancer. 2021; 1(8):789-799. PMC: 7610412. DOI: 10.1038/s43018-020-0087-6. View