» Articles » PMID: 39738110

Unsupervised Inter-domain Transformation for Virtually Stained High-resolution Mid-infrared Photoacoustic Microscopy Using Explainable Deep Learning

Overview
Journal Nat Commun
Specialty Biology
Date 2024 Dec 31
PMID 39738110
Authors
Affiliations
Soon will be listed here.
Abstract

Mid-infrared photoacoustic microscopy can capture biochemical information without staining. However, the long mid-infrared optical wavelengths make the spatial resolution of photoacoustic microscopy significantly poorer than that of conventional confocal fluorescence microscopy. Here, we demonstrate an explainable deep learning-based unsupervised inter-domain transformation of low-resolution unlabeled mid-infrared photoacoustic microscopy images into confocal-like virtually fluorescence-stained high-resolution images. The explainable deep learning-based framework is proposed for this transformation, wherein an unsupervised generative adversarial network is primarily employed and then a saliency constraint is added for better explainability. We validate the performance of explainable deep learning-based mid-infrared photoacoustic microscopy by identifying cell nuclei and filamentous actins in cultured human cardiac fibroblasts and matching them with the corresponding CFM images. The XDL ensures similar saliency between the two domains, making the transformation process more stable and more reliable than existing networks. Our XDL-MIR-PAM enables label-free high-resolution duplexed cellular imaging, which can significantly benefit many research avenues in cell biology.

References
1.
Moen E, Bannon D, Kudo T, Graf W, Covert M, Van Valen D . Deep learning for cellular image analysis. Nat Methods. 2019; 16(12):1233-1246. PMC: 8759575. DOI: 10.1038/s41592-019-0403-1. View

2.
Belthangady C, Royer L . Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction. Nat Methods. 2019; 16(12):1215-1225. DOI: 10.1038/s41592-019-0458-z. View

3.
Karras T, Laine S, Aila T . A Style-Based Generator Architecture for Generative Adversarial Networks. IEEE Trans Pattern Anal Mach Intell. 2020; 43(12):4217-4228. DOI: 10.1109/TPAMI.2020.2970919. View

4.
Ouyang W, Aristov A, Lelek M, Hao X, Zimmer C . Deep learning massively accelerates super-resolution localization microscopy. Nat Biotechnol. 2018; 36(5):460-468. DOI: 10.1038/nbt.4106. View

5.
Park E, Lee Y, Lee C, Eom T . Effective photoacoustic absorption spectrum for collagen-based tissue imaging. J Biomed Opt. 2020; 25(5):1-8. PMC: 7219632. DOI: 10.1117/1.JBO.25.5.056002. View