Adaptive Particle Representation of Fluorescence Microscopy Images

Overview

Journal Nat Commun

Specialty Biology

Date 2018 Dec 6

PMID 30514837

Citations 6

Authors

Bevan L Cheeseman

Ulrik Gunther

Krzysztof Gonciarz

Mateusz Susik

Ivo F Sbalzarini

Affiliations

Soon will be listed here.

Abstract

Modern microscopes create a data deluge with gigabytes of data generated each second, and terabytes per day. Storing and processing this data is a severe bottleneck, not fully alleviated by data compression. We argue that this is because images are processed as grids of pixels. To address this, we propose a content-adaptive representation of fluorescence microscopy images, the Adaptive Particle Representation (APR). The APR replaces pixels with particles positioned according to image content. The APR overcomes storage bottlenecks, as data compression does, but additionally overcomes memory and processing bottlenecks. Using noisy 3D images, we show that the APR adaptively represents the content of an image while maintaining image quality and that it enables orders of magnitude benefits across a range of image processing tasks. The APR provides a simple and efficient content-aware representation of fluosrescence microscopy images.

Citing Articles

Whole-brain Optical Imaging: A Powerful Tool for Precise Brain Mapping at the Mesoscopic Level.

Jiang T, Gong H, Yuan J Neurosci Bull. 2023; 39(12):1840-1858.

PMID: 37715920 PMC: 10661546. DOI: 10.1007/s12264-023-01112-y.

Maximized Spatial Information and Minimized Acquisition Time of Top-Hat IR-MALDESI-MSI of Zebrafish Using Nested Regions of Interest (nROIs).

Joignant A, Ritter M, Knizner K, Garrard K, Kullman S, Muddiman D J Am Soc Mass Spectrom. 2023; 34(9):2043-2050.

PMID: 37526449 PMC: 11137852. DOI: 10.1021/jasms.3c00210.

Developing open-source software for bioimage analysis: opportunities and challenges.

Levet F, Carpenter A, Eliceiri K, Kreshuk A, Bankhead P, Haase R F1000Res. 2021; 10:302.

PMID: 34249339 PMC: 8226416. DOI: 10.12688/f1000research.52531.1.

Tissue clearing and its applications in neuroscience.

Ueda H, Erturk A, Chung K, Gradinaru V, Chedotal A, Tomancak P Nat Rev Neurosci. 2020; 21(2):61-79.

PMID: 31896771 PMC: 8121164. DOI: 10.1038/s41583-019-0250-1.

Multi-scale imaging and analysis identify pan-embryo cell dynamics of germlayer formation in zebrafish.

Shah G, Thierbach K, Schmid B, Waschke J, Reade A, Hlawitschka M Nat Commun. 2019; 10(1):5753.

PMID: 31848345 PMC: 6917746. DOI: 10.1038/s41467-019-13625-0.

References

Goldberg I, Allan C, Burel J, Creager D, Falconi A, Hochheiser H . The Open Microscopy Environment (OME) Data Model and XML file: open tools for informatics and quantitative analysis in biological imaging. Genome Biol. 2005; 6(5):R47. PMC: 1175959. DOI: 10.1186/gb-2005-6-5-r47. View

Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Susstrunk S . SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell. 2012; 34(11):2274-82. DOI: 10.1109/TPAMI.2012.120. View

Weigert M, Schmidt U, Boothe T, Muller A, Dibrov A, Jain A . Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat Methods. 2018; 15(12):1090-1097. DOI: 10.1038/s41592-018-0216-7. View

Yang Y, Wernick M, Brankov J . A fast approach for accurate content-adaptive mesh generation. IEEE Trans Image Process. 2008; 12(8):866-81. DOI: 10.1109/TIP.2003.812757. View

Koch K, McLean J, Segev R, Freed M, Berry 2nd M, Balasubramanian V . How much the eye tells the brain. Curr Biol. 2006; 16(14):1428-34. PMC: 1564115. DOI: 10.1016/j.cub.2006.05.056. View

Reynaud E, Peychl J, Huisken J, Tomancak P . Guide to light-sheet microscopy for adventurous biologists. Nat Methods. 2014; 12(1):30-4. DOI: 10.1038/nmeth.3222. View

Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T . Fiji: an open-source platform for biological-image analysis. Nat Methods. 2012; 9(7):676-82. PMC: 3855844. DOI: 10.1038/nmeth.2019. View

Boykov Y, Kolmogorov V . An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell. 2005; 26(9):1124-37. DOI: 10.1109/TPAMI.2004.60. View

Afshar Y, Sbalzarini I . A Parallel Distributed-Memory Particle Method Enables Acquisition-Rate Segmentation of Large Fluorescence Microscopy Images. PLoS One. 2016; 11(4):e0152528. PMC: 4821481. DOI: 10.1371/journal.pone.0152528. View

10.

Amat F, Myers E, Keller P . Fast and robust optical flow for time-lapse microscopy using super-voxels. Bioinformatics. 2012; 29(3):373-80. PMC: 3562071. DOI: 10.1093/bioinformatics/bts706. View

11.

Reinagel P, Zador A . Natural scene statistics at the centre of gaze. Network. 2000; 10(4):341-50. View

12.

Royer L, Lemon W, Chhetri R, Wan Y, Coleman M, Myers E . Adaptive light-sheet microscopy for long-term, high-resolution imaging in living organisms. Nat Biotechnol. 2016; 34(12):1267-1278. DOI: 10.1038/nbt.3708. View

13.

Smirnakis S, Berry M, Warland D, Bialek W, Meister M . Adaptation of retinal processing to image contrast and spatial scale. Nature. 1997; 386(6620):69-73. DOI: 10.1038/386069a0. View

14.

Weber M, Huisken J . Light sheet microscopy for real-time developmental biology. Curr Opin Genet Dev. 2011; 21(5):566-72. DOI: 10.1016/j.gde.2011.09.009. View

15.

Prasher D, Eckenrode V, Ward W, Prendergast F, Cormier M . Primary structure of the Aequorea victoria green-fluorescent protein. Gene. 1992; 111(2):229-33. DOI: 10.1016/0378-1119(92)90691-h. View

16.

Monasse P, Guichard F . Fast computation of a contrast-invariant image representation. IEEE Trans Image Process. 2008; 9(5):860-72. DOI: 10.1109/83.841532. View

17.

Daetwyler S, Huisken J . Fast Fluorescence Microscopy with Light Sheets. Biol Bull. 2016; 231(1):14-25. DOI: 10.1086/689588. View

18.

Gong Y, Sbalzarini I . Curvature Filters Efficiently Reduce Certain Variational Energies. IEEE Trans Image Process. 2017; 26(4):1786-1798. DOI: 10.1109/TIP.2017.2658954. View

19.

Chen B, Legant W, Wang K, Shao L, Milkie D, Davidson M . Lattice light-sheet microscopy: imaging molecules to embryos at high spatiotemporal resolution. Science. 2014; 346(6208):1257998. PMC: 4336192. DOI: 10.1126/science.1257998. View

20.

Keller P, Schmidt A, Wittbrodt J, Stelzer E . Reconstruction of zebrafish early embryonic development by scanned light sheet microscopy. Science. 2008; 322(5904):1065-9. DOI: 10.1126/science.1162493. View