» Articles » PMID: 37868222

UTILE-Gen: Automated Image Analysis in Nanoscience Using Synthetic Dataset Generator and Deep Learning

Overview
Journal ACS Nanosci Au
Specialty Biotechnology
Date 2023 Oct 23
PMID 37868222
Authors
Affiliations
Soon will be listed here.
Abstract

This work presents the development and implementation of a deep learning-based workflow for autonomous image analysis in nanoscience. A versatile, agnostic, and configurable tool was developed to generate instance-segmented imaging datasets of nanoparticles. The synthetic generator tool employs domain randomization to expand the image/mask pairs dataset for training supervised deep learning models. The approach eliminates tedious manual annotation and allows training of high-performance models for microscopy image analysis based on convolutional neural networks. We demonstrate how the expanded training set can significantly improve the performance of the classification and instance segmentation models for a variety of nanoparticle shapes, ranging from spherical-, cubic-, to rod-shaped nanoparticles. Finally, the trained models were deployed in a cloud-based analytics platform for the autonomous particle analysis of microscopy images.

References
1.
Yildirim B, Cole J . Bayesian Particle Instance Segmentation for Electron Microscopy Image Quantification. J Chem Inf Model. 2021; 61(3):1136-1149. PMC: 8041280. DOI: 10.1021/acs.jcim.0c01455. View

2.
Kharin A . Deep learning for scanning electron microscopy: Synthetic data for the nanoparticles detection. Ultramicroscopy. 2020; 219:113125. DOI: 10.1016/j.ultramic.2020.113125. View

3.
Eslamibidgoli M, Tipp F, Jitsev J, Jankovic J, Eikerling M, Malek K . Convolutional neural networks for high throughput screening of catalyst layer inks for polymer electrolyte fuel cells. RSC Adv. 2022; 11(51):32126-32134. PMC: 9041760. DOI: 10.1039/d1ra05324h. View

4.
Toda Y, Okura F, Ito J, Okada S, Kinoshita T, Tsuji H . Training instance segmentation neural network with synthetic datasets for crop seed phenotyping. Commun Biol. 2020; 3(1):173. PMC: 7160130. DOI: 10.1038/s42003-020-0905-5. View

5.
Hendriksen A, Buhrer M, Leone L, Merlini M, Vigano N, Pelt D . Deep denoising for multi-dimensional synchrotron X-ray tomography without high-quality reference data. Sci Rep. 2021; 11(1):11895. PMC: 8178391. DOI: 10.1038/s41598-021-91084-8. View