Machine Learning Methods for Histopathological Image Analysis: Updates in 2024

Overview

Journal Comput Struct Biotechnol J

Date 2025 Feb 3

PMID 39897057

Authors

Daisuke Komura

Mieko Ochi

Shumpei Ishikawa

Affiliations

Soon will be listed here.

Abstract

The combination of artificial intelligence and digital pathology has emerged as a transformative force in healthcare and biomedical research. As an update to our 2018 review, this review presents comprehensive analysis of machine learning applications in histopathological image analysis, with focus on the developments since 2018. We highlight significant advances that have expanded the technical capabilities and practical applications of computational pathology. The review examines progress in addressing key challenges in the field as follows: processing of gigapixel whole slide images, insufficient labeled data, multidimensional analysis, domain shifts across institutions, and interpretability of machine learning models. We evaluate emerging trends, such as foundation models and multimodal integration, that are reshaping the field. Overall, our review highlights the potential of machine learning in enhancing both routine pathological analysis and scientific discovery in pathology. By providing this comprehensive overview, this review aims to guide researchers and clinicians in understanding the current state of the pathology image analysis field and its future trajectory.

References

Echle A, Rindtorff N, Brinker T, Luedde T, Pearson A, Kather J . Deep learning in cancer pathology: a new generation of clinical biomarkers. Br J Cancer. 2020; 124(4):686-696. PMC: 7884739. DOI: 10.1038/s41416-020-01122-x. View

Zhang X, Wang S, Rudzinski E, Agarwal S, Rong R, Barkauskas D . Deep Learning of Rhabdomyosarcoma Pathology Images for Classification and Survival Outcome Prediction. Am J Pathol. 2022; 192(6):917-925. PMC: 9194647. DOI: 10.1016/j.ajpath.2022.03.011. View

Yamashita R, Long J, Longacre T, Peng L, Berry G, Martin B . Deep learning model for the prediction of microsatellite instability in colorectal cancer: a diagnostic study. Lancet Oncol. 2021; 22(1):132-141. DOI: 10.1016/S1470-2045(20)30535-0. View

Cho U, Im S, Park H . Exploring histological predictive biomarkers for immune checkpoint inhibitor therapy response in non-small cell lung cancer. J Pathol Transl Med. 2024; 58(2):49-58. PMC: 10948248. DOI: 10.4132/jptm.2024.01.31. View

Coudray N, Ocampo P, Sakellaropoulos T, Narula N, Snuderl M, Fenyo D . Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018; 24(10):1559-1567. PMC: 9847512. DOI: 10.1038/s41591-018-0177-5. View

Lu M, Williamson D, Chen T, Chen R, Barbieri M, Mahmood F . Data-efficient and weakly supervised computational pathology on whole-slide images. Nat Biomed Eng. 2021; 5(6):555-570. PMC: 8711640. DOI: 10.1038/s41551-020-00682-w. View

Vorontsov E, Bozkurt A, Casson A, Shaikovski G, Zelechowski M, Severson K . A foundation model for clinical-grade computational pathology and rare cancers detection. Nat Med. 2024; 30(10):2924-2935. PMC: 11485232. DOI: 10.1038/s41591-024-03141-0. View

Steyaert S, Pizurica M, Nagaraj D, Khandelwal P, Hernandez-Boussard T, Gentles A . Multimodal data fusion for cancer biomarker discovery with deep learning. Nat Mach Intell. 2023; 5(4):351-362. PMC: 10484010. DOI: 10.1038/s42256-023-00633-5. View

Faryna K, van der Laak J, Litjens G . Automatic data augmentation to improve generalization of deep learning in H&E stained histopathology. Comput Biol Med. 2024; 170:108018. DOI: 10.1016/j.compbiomed.2024.108018. View

10.

Lu M, Chen R, Kong D, Lipkova J, Singh R, Williamson D . Federated learning for computational pathology on gigapixel whole slide images. Med Image Anal. 2021; 76:102298. PMC: 9340569. DOI: 10.1016/j.media.2021.102298. View

11.

Horst F, Rempe M, Heine L, Seibold C, Keyl J, Baldini G . CellViT: Vision Transformers for precise cell segmentation and classification. Med Image Anal. 2024; 94:103143. DOI: 10.1016/j.media.2024.103143. View

12.

Jia Y, Liu J, Chen L, Zhao T, Wang Y . THItoGene: a deep learning method for predicting spatial transcriptomics from histological images. Brief Bioinform. 2023; 25(1). PMC: 10749789. DOI: 10.1093/bib/bbad464. View

13.

Kalra S, Tizhoosh H, Choi C, Shah S, Diamandis P, Campbell C . Yottixel - An Image Search Engine for Large Archives of Histopathology Whole Slide Images. Med Image Anal. 2020; 65:101757. DOI: 10.1016/j.media.2020.101757. View

14.

Verma R, Kumar N, Patil A, Kurian N, Rane S, Graham S . MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge. IEEE Trans Med Imaging. 2021; 40(12):3413-3423. DOI: 10.1109/TMI.2021.3085712. View

15.

Zhang X, Zhao Z, Wang R, Chen H, Zheng X, Liu L . A multicenter proof-of-concept study on deep learning-based intraoperative discrimination of primary central nervous system lymphoma. Nat Commun. 2024; 15(1):3768. PMC: 11069536. DOI: 10.1038/s41467-024-48171-x. View

16.

Kanwal N, Lopez-Perez M, Kiraz U, Zuiverloon T, Molina R, Engan K . Are you sure it's an artifact? Artifact detection and uncertainty quantification in histological images. Comput Med Imaging Graph. 2024; 112:102321. DOI: 10.1016/j.compmedimag.2023.102321. View

17.

DeGrave A, Cai Z, Janizek J, Daneshjou R, Lee S . Auditing the inference processes of medical-image classifiers by leveraging generative AI and the expertise of physicians. Nat Biomed Eng. 2023; . DOI: 10.1038/s41551-023-01160-9. View

18.

Tellez D, Litjens G, Bandi P, Bulten W, Bokhorst J, Ciompi F . Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology. Med Image Anal. 2019; 58:101544. DOI: 10.1016/j.media.2019.101544. View

19.

Kather J, Pearson A, Halama N, Jager D, Krause J, Loosen S . Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer. Nat Med. 2019; 25(7):1054-1056. PMC: 7423299. DOI: 10.1038/s41591-019-0462-y. View

20.

Steyaert S, Qiu Y, Zheng Y, Mukherjee P, Vogel H, Gevaert O . Multimodal deep learning to predict prognosis in adult and pediatric brain tumors. Commun Med (Lond). 2023; 3(1):44. PMC: 10060397. DOI: 10.1038/s43856-023-00276-y. View