» Articles » PMID: 38280188

MMV_Im2Im: an Open-source Microscopy Machine Vision Toolbox for Image-to-image Transformation

Overview
Journal Gigascience
Specialties Biology
Genetics
Date 2024 Jan 27
PMID 38280188
Authors
Affiliations
Soon will be listed here.
Abstract

Over the past decade, deep learning (DL) research in computer vision has been growing rapidly, with many advances in DL-based image analysis methods for biomedical problems. In this work, we introduce MMV_Im2Im, a new open-source Python package for image-to-image transformation in bioimaging applications. MMV_Im2Im is designed with a generic image-to-image transformation framework that can be used for a wide range of tasks, including semantic segmentation, instance segmentation, image restoration, image generation, and so on. Our implementation takes advantage of state-of-the-art machine learning engineering techniques, allowing researchers to focus on their research without worrying about engineering details. We demonstrate the effectiveness of MMV_Im2Im on more than 10 different biomedical problems, showcasing its general potentials and applicabilities. For computational biomedical researchers, MMV_Im2Im provides a starting point for developing new biomedical image analysis or machine learning algorithms, where they can either reuse the code in this package or fork and extend this package to facilitate the development of new methods. Experimental biomedical researchers can benefit from this work by gaining a comprehensive view of the image-to-image transformation concept through diversified examples and use cases. We hope this work can give the community inspirations on how DL-based image-to-image transformation can be integrated into the assay development process, enabling new biomedical studies that cannot be done only with traditional experimental assays. To help researchers get started, we have provided source code, documentation, and tutorials for MMV_Im2Im at [https://github.com/MMV-Lab/mmv_im2im] under MIT license.

Citing Articles

Deep-learning-based image compression for microscopy images: An empirical study.

Zhou Y, Sollmann J, Chen J Biol Imaging. 2025; 4():e16.

PMID: 39776609 PMC: 11704128. DOI: 10.1017/S2633903X24000151.


MMV_Im2Im: an open-source microscopy machine vision toolbox for image-to-image transformation.

Sonneck J, Zhou Y, Chen J Gigascience. 2024; 13.

PMID: 38280188 PMC: 10821710. DOI: 10.1093/gigascience/giad120.

References
1.
Weigert M, Schmidt U, Boothe T, Muller A, Dibrov A, Jain A . Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat Methods. 2018; 15(12):1090-1097. DOI: 10.1038/s41592-018-0216-7. View

2.
He K, Gkioxari G, Dollar P, Girshick R . Mask R-CNN. IEEE Trans Pattern Anal Mach Intell. 2018; 42(2):386-397. DOI: 10.1109/TPAMI.2018.2844175. View

3.
Fang L, Monroe F, Novak S, Kirk L, Schiavon C, Yu S . Deep learning-based point-scanning super-resolution imaging. Nat Methods. 2021; 18(4):406-416. PMC: 8035334. DOI: 10.1038/s41592-021-01080-z. View

4.
Sirinukunwattana K, Snead D, Rajpoot N . A Stochastic Polygons Model for Glandular Structures in Colon Histology Images. IEEE Trans Med Imaging. 2015; 34(11):2366-78. DOI: 10.1109/TMI.2015.2433900. View

5.
Cutler K, Stringer C, Lo T, Rappez L, Stroustrup N, Peterson S . Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation. Nat Methods. 2022; 19(11):1438-1448. PMC: 9636021. DOI: 10.1038/s41592-022-01639-4. View