A High-Resolution Digital Pathological Image Staining Style Transfer Model Based on Gradient Guidance

Overview

Journal Bioengineering (Basel)

Date 2025 Feb 26

PMID 40001706

Authors

Yutao Tang

Yuanpin Zhou

Siyu Zhang

Yao Lu

Affiliations

Soon will be listed here.

Abstract

Digital pathology images have long been regarded as the gold standard for cancer diagnosis in clinical medicine. A highly generalized digital pathological image diagnosis system can provide strong support for cancer diagnosis, help to improve the diagnostic efficiency and accuracy of doctors, and has important research value. The whole slide image of different centers can lead to very large staining differences due to different scanners and dyes, which pose a challenge to the generalization performance of the model application in multi-center data testing. In order to achieve the normalization of multi-center data, this paper proposes a style transfer algorithm based on an adversarial generative network for high-resolution images. The gradient-guided dye migration model proposed in this paper introduces a gradient-enhanced regularized term in the loss function design of the algorithm. A style transfer algorithm was applied to the source data, and the diagnostic performance of the multi-example learning model based on the domain data was significantly improved by validation in the pathological image datasets of two centers. The proposed method improved the AUC of the best classification model from 0.8856 to 0.9243, and another set of experiments improved the AUC from 0.8012 to 0.8313.

References

Gurcan M, Boucheron L, Can A, Madabhushi A, Rajpoot N, Yener B . Histopathological image analysis: a review. IEEE Rev Biomed Eng. 2010; 2:147-71. PMC: 2910932. DOI: 10.1109/RBME.2009.2034865. View

Roy S, Kumar Jain A, Lal S, Kini J . A study about color normalization methods for histopathology images. Micron. 2018; 114:42-61. DOI: 10.1016/j.micron.2018.07.005. View

Khan A, Rajpoot N, Treanor D, Magee D . A nonlinear mapping approach to stain normalization in digital histopathology images using image-specific color deconvolution. IEEE Trans Biomed Eng. 2014; 61(6):1729-38. DOI: 10.1109/TBME.2014.2303294. View

Shin S, Chan You S, Jeon H, Jung J, An M, Park R . Style transfer strategy for developing a generalizable deep learning application in digital pathology. Comput Methods Programs Biomed. 2020; 198:105815. DOI: 10.1016/j.cmpb.2020.105815. View

Elmore J, Longton G, Carney P, Geller B, Onega T, Tosteson A . Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA. 2015; 313(11):1122-32. PMC: 4516388. DOI: 10.1001/jama.2015.1405. View

Steiner D, MacDonald R, Liu Y, Truszkowski P, Hipp J, Gammage C . Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer. Am J Surg Pathol. 2018; 42(12):1636-1646. PMC: 6257102. DOI: 10.1097/PAS.0000000000001151. View

Smits A, Kummer J, de Bruin P, Bol M, van den Tweel J, Seldenrijk K . The estimation of tumor cell percentage for molecular testing by pathologists is not accurate. Mod Pathol. 2013; 27(2):168-74. DOI: 10.1038/modpathol.2013.134. View

Viray H, Li K, Long T, Vasalos P, Bridge J, Jennings L . A prospective, multi-institutional diagnostic trial to determine pathologist accuracy in estimation of percentage of malignant cells. Arch Pathol Lab Med. 2013; 137(11):1545-9. DOI: 10.5858/arpa.2012-0561-CP. View

Coudray N, Ocampo P, Sakellaropoulos T, Narula N, Snuderl M, Fenyo D . Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018; 24(10):1559-1567. PMC: 9847512. DOI: 10.1038/s41591-018-0177-5. View

10.

Lu M, Williamson D, Chen T, Chen R, Barbieri M, Mahmood F . Data-efficient and weakly supervised computational pathology on whole-slide images. Nat Biomed Eng. 2021; 5(6):555-570. PMC: 8711640. DOI: 10.1038/s41551-020-00682-w. View

11.

Li X, Plataniotis K . A Complete Color Normalization Approach to Histopathology Images Using Color Cues Computed From Saturation-Weighted Statistics. IEEE Trans Biomed Eng. 2015; 62(7):1862-73. DOI: 10.1109/TBME.2015.2405791. View

12.

Janowczyk A, Basavanhally A, Madabhushi A . Stain Normalization using Sparse AutoEncoders (StaNoSA): Application to digital pathology. Comput Med Imaging Graph. 2016; 57:50-61. PMC: 5112159. DOI: 10.1016/j.compmedimag.2016.05.003. View

13.

Coltuc D, Bolon P, Chassery J . Exact histogram specification. IEEE Trans Image Process. 2006; 15(5):1143-52. DOI: 10.1109/tip.2005.864170. View

14.

Chong X, Madeti Y, Cai J, Li W, Cong L, Lu J . Recent developments in immunotherapy for gastrointestinal tract cancers. J Hematol Oncol. 2024; 17(1):65. PMC: 11316403. DOI: 10.1186/s13045-024-01578-x. View

15.

Yu K, Zhang C, Berry G, Altman R, Re C, Rubin D . Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features. Nat Commun. 2016; 7:12474. PMC: 4990706. DOI: 10.1038/ncomms12474. View

16.

Tellez D, Balkenhol M, Otte-Holler I, van de Loo R, Vogels R, Bult P . Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks. IEEE Trans Med Imaging. 2018; 37(9):2126-2136. DOI: 10.1109/TMI.2018.2820199. View

17.

Litjens G, Sanchez C, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I . Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016; 6:26286. PMC: 4876324. DOI: 10.1038/srep26286. View

18.

BenTaieb A, Hamarneh G . Adversarial Stain Transfer for Histopathology Image Analysis. IEEE Trans Med Imaging. 2018; 37(3):792-802. DOI: 10.1109/TMI.2017.2781228. View

19.

Madabhushi A, Lee G . Image analysis and machine learning in digital pathology: Challenges and opportunities. Med Image Anal. 2016; 33:170-175. PMC: 5556681. DOI: 10.1016/j.media.2016.06.037. View

20.

Wei J, Tafe L, Linnik Y, Vaickus L, Tomita N, Hassanpour S . Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networks. Sci Rep. 2019; 9(1):3358. PMC: 6399447. DOI: 10.1038/s41598-019-40041-7. View