» Articles » PMID: 39329154

Explainable Rotation-invariant Self-supervised Representation Learning

Overview
Journal MethodsX
Specialty Pathology
Date 2024 Sep 27
PMID 39329154
Authors
Affiliations
Soon will be listed here.
Abstract

This paper describes a method that can perform robust detection and classification in out-of-distribution rotated images in the medical domain. In real-world medical imaging tools, noise due to the rotation of the body part is frequently observed. This noise reduces the accuracy of AI-based classification and prediction models. Hence, it is important to develop models which are rotation invariant. To that end, the proposed method - RISC (rotation invariant self-supervised vision framework) addresses this issue of rotational corruption. We present state-of-the-art rotation-invariant classification results and provide explainability for the performance in the domain. The evaluation of the proposed method is carried out on real-world adversarial examples in Medical Imagery-OrganAMNIST, RetinaMNIST and PneumoniaMNIST. It is observed that RISC outperforms the rotation-affected benchmark methods by obtaining 22\%, 17\% and 2\% accuracy boost on OrganAMNIST, PneumoniaMNIST and RetinaMNIST rotated baselines respectively. Further, explainability results are demonstrated. This methods paper describes:•a representation learning approach that can perform robust detection and classification in out-of-distribution rotated images in the medical domain.•It presents a method that incorporates self-supervised rotation invariance for correcting rotational corruptions.•GradCAM-based explainability for the rotational SSL pretext task and the downstream classification outcomes for the three benchmark datasets are presented.

References
1.
Yang J, Shi R, Wei D, Liu Z, Zhao L, Ke B . MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classification. Sci Data. 2023; 10(1):41. PMC: 9852451. DOI: 10.1038/s41597-022-01721-8. View

2.
Liu R, Wang X, Wu Q, Dai L, Fang X, Yan T . DeepDRiD: Diabetic Retinopathy-Grading and Image Quality Estimation Challenge. Patterns (N Y). 2022; 3(6):100512. PMC: 9214346. DOI: 10.1016/j.patter.2022.100512. View

3.
Suzuki K . Overview of deep learning in medical imaging. Radiol Phys Technol. 2017; 10(3):257-273. DOI: 10.1007/s12194-017-0406-5. View

4.
Cheng G, Han J, Zhou P, Xu D . Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection. IEEE Trans Image Process. 2018; 28(1):265-278. DOI: 10.1109/TIP.2018.2867198. View

5.
Kermany D, Goldbaum M, Cai W, Valentim C, Liang H, Baxter S . Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning. Cell. 2018; 172(5):1122-1131.e9. DOI: 10.1016/j.cell.2018.02.010. View