Contrastive Multiple Instance Learning: An Unsupervised Framework for Learning Slide-Level Representations of Whole Slide Histopathology Images Without Labels
Overview
Affiliations
Recent methods in computational pathology have trended towards semi- and weakly-supervised methods requiring only slide-level labels. Yet, even slide-level labels may be absent or irrelevant to the application of interest, such as in clinical trials. Hence, we present a fully unsupervised method to learn meaningful, compact representations of WSIs. Our method initially trains a tile-wise encoder using SimCLR, from which subsets of tile-wise embeddings are extracted and fused via an attention-based multiple-instance learning framework to yield slide-level representations. The resulting set of intra-slide-level and inter-slide-level embeddings are attracted and repelled via contrastive loss, respectively. This resulted in slide-level representations with self-supervision. We applied our method to two tasks- (1) non-small cell lung cancer subtyping (NSCLC) as a classification prototype and (2) breast cancer proliferation scoring (TUPAC16) as a regression prototype-and achieved an AUC of 0.8641 ± 0.0115 and correlation (R) of 0.5740 ± 0.0970, respectively. Ablation experiments demonstrate that the resulting unsupervised slide-level feature space can be fine-tuned with small datasets for both tasks. Overall, our method approaches computational pathology in a novel manner, where meaningful features can be learned from whole-slide images without the need for annotations of slide-level labels. The proposed method stands to benefit computational pathology, as it theoretically enables researchers to benefit from completely unlabeled whole-slide images.
Tavolara T, Khan Niazi M, Feldman A, Jaye D, Flowers C, Cooper L Diagn Pathol. 2024; 19(1):17.
PMID: 38243330 PMC: 10797911. DOI: 10.1186/s13000-023-01425-6.
SAMPLER: unsupervised representations for rapid analysis of whole slide tissue images.
Mukashyaka P, Sheridan T, Foroughi Pour A, Chuang J EBioMedicine. 2023; 99:104908.
PMID: 38101298 PMC: 10733087. DOI: 10.1016/j.ebiom.2023.104908.
Su Z, Rezapour M, Sajjad U, Gurcan M, Niazi M Comput Biol Med. 2023; 167:107607.
PMID: 37890421 PMC: 10699124. DOI: 10.1016/j.compbiomed.2023.107607.
Davri A, Birbas E, Kanavos T, Ntritsos G, Giannakeas N, Tzallas A Cancers (Basel). 2023; 15(15).
PMID: 37568797 PMC: 10417369. DOI: 10.3390/cancers15153981.
BCR-Net: A deep learning framework to predict breast cancer recurrence from histopathology images.
Su Z, Niazi M, Tavolara T, Niu S, Tozbikian G, Wesolowski R PLoS One. 2023; 18(4):e0283562.
PMID: 37014891 PMC: 10072418. DOI: 10.1371/journal.pone.0283562.