» Articles » PMID: 36497258

Contrastive Multiple Instance Learning: An Unsupervised Framework for Learning Slide-Level Representations of Whole Slide Histopathology Images Without Labels

Overview
Journal Cancers (Basel)
Publisher MDPI
Specialty Oncology
Date 2022 Dec 11
PMID 36497258
Authors
Affiliations
Soon will be listed here.
Abstract

Recent methods in computational pathology have trended towards semi- and weakly-supervised methods requiring only slide-level labels. Yet, even slide-level labels may be absent or irrelevant to the application of interest, such as in clinical trials. Hence, we present a fully unsupervised method to learn meaningful, compact representations of WSIs. Our method initially trains a tile-wise encoder using SimCLR, from which subsets of tile-wise embeddings are extracted and fused via an attention-based multiple-instance learning framework to yield slide-level representations. The resulting set of intra-slide-level and inter-slide-level embeddings are attracted and repelled via contrastive loss, respectively. This resulted in slide-level representations with self-supervision. We applied our method to two tasks- (1) non-small cell lung cancer subtyping (NSCLC) as a classification prototype and (2) breast cancer proliferation scoring (TUPAC16) as a regression prototype-and achieved an AUC of 0.8641 ± 0.0115 and correlation (R) of 0.5740 ± 0.0970, respectively. Ablation experiments demonstrate that the resulting unsupervised slide-level feature space can be fine-tuned with small datasets for both tasks. Overall, our method approaches computational pathology in a novel manner, where meaningful features can be learned from whole-slide images without the need for annotations of slide-level labels. The proposed method stands to benefit computational pathology, as it theoretically enables researchers to benefit from completely unlabeled whole-slide images.

Citing Articles

Translating prognostic quantification of c-MYC and BCL2 from tissue microarrays to whole slide images in diffuse large B-cell lymphoma using deep learning.

Tavolara T, Khan Niazi M, Feldman A, Jaye D, Flowers C, Cooper L Diagn Pathol. 2024; 19(1):17.

PMID: 38243330 PMC: 10797911. DOI: 10.1186/s13000-023-01425-6.


SAMPLER: unsupervised representations for rapid analysis of whole slide tissue images.

Mukashyaka P, Sheridan T, Foroughi Pour A, Chuang J EBioMedicine. 2023; 99:104908.

PMID: 38101298 PMC: 10733087. DOI: 10.1016/j.ebiom.2023.104908.


Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide images.

Su Z, Rezapour M, Sajjad U, Gurcan M, Niazi M Comput Biol Med. 2023; 167:107607.

PMID: 37890421 PMC: 10699124. DOI: 10.1016/j.compbiomed.2023.107607.


Deep Learning for Lung Cancer Diagnosis, Prognosis and Prediction Using Histological and Cytological Images: A Systematic Review.

Davri A, Birbas E, Kanavos T, Ntritsos G, Giannakeas N, Tzallas A Cancers (Basel). 2023; 15(15).

PMID: 37568797 PMC: 10417369. DOI: 10.3390/cancers15153981.


BCR-Net: A deep learning framework to predict breast cancer recurrence from histopathology images.

Su Z, Niazi M, Tavolara T, Niu S, Tozbikian G, Wesolowski R PLoS One. 2023; 18(4):e0283562.

PMID: 37014891 PMC: 10072418. DOI: 10.1371/journal.pone.0283562.


References
1.
Xu H, Park S, Hwang T . Computerized Classification of Prostate Cancer Gleason Scores from Whole Slide Images. IEEE/ACM Trans Comput Biol Bioinform. 2019; 17(6):1871-1882. DOI: 10.1109/TCBB.2019.2941195. View

2.
Bejnordi B, Veta M, van Diest P, van Ginneken B, Karssemeijer N, Litjens G . Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer. JAMA. 2017; 318(22):2199-2210. PMC: 5820737. DOI: 10.1001/jama.2017.14585. View

3.
Sornapudi S, Stanley R, V Stoecker W, Almubarak H, Long R, Antani S . Deep Learning Nuclei Detection in Digitized Histology Images by Superpixels. J Pathol Inform. 2018; 9:5. PMC: 5869967. DOI: 10.4103/jpi.jpi_74_17. View

4.
Litjens G, Kooi T, Bejnordi B, Setio A, Ciompi F, Ghafoorian M . A survey on deep learning in medical image analysis. Med Image Anal. 2017; 42:60-88. DOI: 10.1016/j.media.2017.07.005. View

5.
Weinstein J, Collisson E, Mills G, Mills Shaw K, Ozenberger B, Ellrott K . The Cancer Genome Atlas Pan-Cancer analysis project. Nat Genet. 2013; 45(10):1113-20. PMC: 3919969. DOI: 10.1038/ng.2764. View