Real-time Volumetric Reconstruction of Biological Dynamics with Light-field Microscopy and Deep Learning

Overview

Journal Nat Methods

Specialties Biomedical Engineering
Pathology

Date 2021 Feb 12

PMID 33574612

Citations 56

Authors

Zhaoqiang Wang

Lanxin Zhu

Hao Zhang

Guo Li

Chengqiang Yi

Yi Li

Yicong Yang

Yichen Ding

Mei Zhen

Shangbang Gao

Tzung K Hsiai

Peng Fei

Affiliations

Soon will be listed here.

Abstract

Light-field microscopy has emerged as a technique of choice for high-speed volumetric imaging of fast biological processes. However, artifacts, nonuniform resolution and a slow reconstruction speed have limited its full capabilities for in toto extraction of dynamic spatiotemporal patterns in samples. Here, we combined a view-channel-depth (VCD) neural network with light-field microscopy to mitigate these limitations, yielding artifact-free three-dimensional image sequences with uniform spatial resolution and high-video-rate reconstruction throughput. We imaged neuronal activities across moving Caenorhabditis elegans and blood flow in a beating zebrafish heart at single-cell resolution with volumetric imaging rates up to 200 Hz.

Citing Articles

Ultrafast optical imaging techniques for exploring rapid neuronal dynamics.

Nguyen T, Shalaby R, Lee E, Kim S, Ro Kim Y, Kim S Neurophotonics. 2025; 12(Suppl 1):S14608.

PMID: 40017464 PMC: 11867703. DOI: 10.1117/1.NPh.12.S1.S14608.

Deep learning in light-matter interactions.

Midtvedt D, Mylnikov V, Stilgoe A, Kall M, Rubinsztein-Dunlop H, Volpe G Nanophotonics. 2024; 11(14):3189-3214.

PMID: 39635557 PMC: 11501725. DOI: 10.1515/nanoph-2022-0197.

Deep learning methods for high-resolution microscale light field image reconstruction: a survey.

Lin B, Tian Y, Zhang Y, Zhu Z, Wang D Front Bioeng Biotechnol. 2024; 12:1500270.

PMID: 39624772 PMC: 11608970. DOI: 10.3389/fbioe.2024.1500270.

Ultra-fast light-field microscopy with event detection.

Bian L, Chang X, Xu H, Zhang J Light Sci Appl. 2024; 13(1):306.

PMID: 39511142 PMC: 11544014. DOI: 10.1038/s41377-024-01603-1.

Frontiers in artificial intelligence-directed light-sheet microscopy for uncovering biological phenomena and multi-organ imaging.

Zhu E, Li Y, Margolis S, Wang J, Wang K, Zhang Y View (Beijing). 2024; 5(5).

PMID: 39478956 PMC: 11521201. DOI: 10.1002/VIW.20230087.

References

Tinevez J, Perry N, Schindelin J, Hoopes G, Reynolds G, Laplantine E . TrackMate: An open and extensible platform for single-particle tracking. Methods. 2016; 115:80-90. DOI: 10.1016/j.ymeth.2016.09.016. View

Planchon T, Gao L, Milkie D, Davidson M, Galbraith J, Galbraith C . Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination. Nat Methods. 2011; 8(5):417-23. PMC: 3626440. DOI: 10.1038/nmeth.1586. View

Wen Q, Gao S, Zhen M . excitatory ventral cord motor neurons derive rhythm for body undulation. Philos Trans R Soc Lond B Biol Sci. 2018; 373(1758). PMC: 6158216. DOI: 10.1098/rstb.2017.0370. View

Weigert M, Schmidt U, Boothe T, Muller A, Dibrov A, Jain A . Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat Methods. 2018; 15(12):1090-1097. DOI: 10.1038/s41592-018-0216-7. View

Prevedel R, Yoon Y, Hoffmann M, Pak N, Wetzstein G, Kato S . Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy. Nat Methods. 2014; 11(7):727-730. PMC: 4100252. DOI: 10.1038/nmeth.2964. View

Kawano T, Po M, Gao S, Leung G, Ryu W, Zhen M . An imbalancing act: gap junctions reduce the backward motor circuit activity to bias C. elegans for forward locomotion. Neuron. 2011; 72(4):572-86. DOI: 10.1016/j.neuron.2011.09.005. View

Nobauer T, Skocek O, Pernia-Andrade A, Weilguny L, Traub F, Molodtsov M . Video rate volumetric Ca imaging across cortex using seeded iterative demixing (SID) microscopy. Nat Methods. 2017; 14(8):811-818. DOI: 10.1038/nmeth.4341. View

Keller P, Schmidt A, Wittbrodt J, Stelzer E . Reconstruction of zebrafish early embryonic development by scanned light sheet microscopy. Science. 2008; 322(5904):1065-9. DOI: 10.1126/science.1162493. View

Xu T, Huo J, Shao S, Po M, Kawano T, Lu Y . Descending pathway facilitates undulatory wave propagation in through gap junctions. Proc Natl Acad Sci U S A. 2018; 115(19):E4493-E4502. PMC: 5948959. DOI: 10.1073/pnas.1717022115. View

10.

Nguyen J, Shipley F, Linder A, Plummer G, Liu M, Setru S . Whole-brain calcium imaging with cellular resolution in freely behaving Caenorhabditis elegans. Proc Natl Acad Sci U S A. 2015; 113(8):E1074-81. PMC: 4776509. DOI: 10.1073/pnas.1507110112. View

11.

Cong L, Wang Z, Chai Y, Hang W, Shang C, Yang W . Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (). Elife. 2017; 6. PMC: 5644961. DOI: 10.7554/eLife.28158. View

12.

Liebling M, Forouhar A, Gharib M, Fraser S, Dickinson M . Four-dimensional cardiac imaging in living embryos via postacquisition synchronization of nongated slice sequences. J Biomed Opt. 2005; 10(5):054001. DOI: 10.1117/1.2061567. View

13.

Falk T, Mai D, Bensch R, Cicek O, Abdulkadir A, Marrakchi Y . U-Net: deep learning for cell counting, detection, and morphometry. Nat Methods. 2018; 16(1):67-70. DOI: 10.1038/s41592-018-0261-2. View

14.

Broxton M, Grosenick L, Yang S, Cohen N, Andalman A, Deisseroth K . Wave optics theory and 3-D deconvolution for the light field microscope. Opt Express. 2013; 21(21):25418-39. PMC: 3867103. DOI: 10.1364/OE.21.025418. View

15.

Voleti V, Patel K, Li W, Perez Campos C, Bharadwaj S, Yu H . Real-time volumetric microscopy of in vivo dynamics and large-scale samples with SCAPE 2.0. Nat Methods. 2019; 16(10):1054-1062. PMC: 6885017. DOI: 10.1038/s41592-019-0579-4. View

16.

Gao S, Guan S, Fouad A, Meng J, Kawano T, Huang Y . Excitatory motor neurons are local oscillators for backward locomotion. Elife. 2018; 7. PMC: 5780044. DOI: 10.7554/eLife.29915. View

17.

Guo C, Liu W, Hua X, Li H, Jia S . Fourier light-field microscopy. Opt Express. 2019; 27(18):25573-25594. PMC: 6825611. DOI: 10.1364/OE.27.025573. View

18.

Truong T, Holland D, Madaan S, Andreev A, Keomanee-Dizon K, Troll J . High-contrast, synchronous volumetric imaging with selective volume illumination microscopy. Commun Biol. 2020; 3(1):74. PMC: 7021898. DOI: 10.1038/s42003-020-0787-6. View

19.

Mickoleit M, Schmid B, Weber M, Fahrbach F, Hombach S, Reischauer S . High-resolution reconstruction of the beating zebrafish heart. Nat Methods. 2014; 11(9):919-22. DOI: 10.1038/nmeth.3037. View

20.

Restif C, Ibanez-Ventoso C, Vora M, Guo S, Metaxas D, Driscoll M . CeleST: computer vision software for quantitative analysis of C. elegans swim behavior reveals novel features of locomotion. PLoS Comput Biol. 2014; 10(7):e1003702. PMC: 4102393. DOI: 10.1371/journal.pcbi.1003702. View