NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

Overview

Journal IEEE Trans Med Imaging

Date 2023 Apr 5

PMID 37018704

Authors

Junshen Xu

Daniel Moyer

Borjan Gagoski

Juan Eugenio Iglesias

P Ellen Grant

Polina Golland

Elfar Adalsteinsson

Affiliations

Soon will be listed here.

Abstract

Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.

Citing Articles

Scanner-based real-time three-dimensional brain + body slice-to-volume reconstruction for T2-weighted 0.55-T low-field fetal magnetic resonance imaging.

Uus A, Neves Silva S, Aviles Verdera J, Payette K, Hall M, Colford K Pediatr Radiol. 2025; 55(3):556-569.

PMID: 39853394 PMC: 11882667. DOI: 10.1007/s00247-025-06165-x.

IVIM-Morph: Motion-compensated quantitative Intra-voxel Incoherent Motion (IVIM) analysis for functional fetal lung maturity assessment from diffusion-weighted MRI data.

Kertes N, Zaffrani-Reznikov Y, Afacan O, Kurugol S, Warfield S, Freiman M Med Image Anal. 2025; 101:103445.

PMID: 39756266 PMC: 11875909. DOI: 10.1016/j.media.2024.103445.

NExpR: Neural Explicit Representation for fast arbitrary-scale medical image super-resolution.

Pang K, Zhao K, Hung A, Zheng H, Yan R, Sung K Comput Biol Med. 2024; 184:109354.

PMID: 39602975 PMC: 11663104. DOI: 10.1016/j.compbiomed.2024.109354.

Multi-Sensor Learning Enables Information Transfer Across Different Sensory Data and Augments Multi-Modality Imaging.

Zhu L, Chen Y, Liu L, Xing L, Yu L IEEE Trans Pattern Anal Mach Intell. 2024; 47(1):288-304.

PMID: 39302777 PMC: 11875987. DOI: 10.1109/TPAMI.2024.3465649.

Site effects in multisite fetal brain MRI: morphological insights into early brain development.

Xu X, Sun C, Yu H, Yan G, Zhu Q, Kong X Eur Radiol. 2024; .

PMID: 39299951 DOI: 10.1007/s00330-024-11084-w.

References

Xu J, Zhang M, Abaci Turk E, Zhang L, Grant E, Ying K . Fetal Pose Estimation in Volumetric MRI using a 3D Convolution Neural Network. Med Image Comput Comput Assist Interv. 2020; 11767:403-410. PMC: 7267040. DOI: 10.1007/978-3-030-32251-9_44. View

Payette K, De Dumast P, Kebiri H, Ezhov I, Paetzold J, Shit S . An automatic multi-tissue human fetal brain segmentation benchmark using the Fetal Tissue Annotation Dataset. Sci Data. 2021; 8(1):167. PMC: 8260784. DOI: 10.1038/s41597-021-00946-3. View

Jiang S, Xue H, Glover A, Rutherford M, Rueckert D, Hajnal J . MRI of moving subjects using multislice snapshot images with volume reconstruction (SVR): application to fetal, neonatal, and adult brain studies. IEEE Trans Med Imaging. 2007; 26(7):967-80. DOI: 10.1109/TMI.2007.895456. View

Xu J, Moyer D, Grant P, Golland P, Iglesias J, Adalsteinsson E . SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI. Med Image Comput Comput Assist Interv. 2023; 13436:3-13. PMC: 10129054. DOI: 10.1007/978-3-031-16446-0_1. View

Uus A, Zhang T, Jackson L, Roberts T, Rutherford M, Hajnal J . Deformable Slice-to-Volume Registration for Motion Correction of Fetal Body and Placenta MRI. IEEE Trans Med Imaging. 2020; 39(9):2750-2759. PMC: 7116020. DOI: 10.1109/TMI.2020.2974844. View

Sui Y, Afacan O, Jaimes C, Gholipour A, Warfield S . Scan-Specific Generative Neural Network for MRI Super-Resolution Reconstruction. IEEE Trans Med Imaging. 2022; 41(6):1383-1399. PMC: 9208763. DOI: 10.1109/TMI.2022.3142610. View

Marami B, Scherrer B, Afacan O, Erem B, Warfield S, Gholipour A . Motion-Robust Diffusion-Weighted Brain MRI Reconstruction Through Slice-Level Registration-Based Motion Tracking. IEEE Trans Med Imaging. 2016; 35(10):2258-2269. PMC: 5108524. DOI: 10.1109/TMI.2016.2555244. View

Van Essen D, Smith S, Barch D, Behrens T, Yacoub E, Ugurbil K . The WU-Minn Human Connectome Project: an overview. Neuroimage. 2013; 80:62-79. PMC: 3724347. DOI: 10.1016/j.neuroimage.2013.05.041. View

Tourbier S, Bresson X, Hagmann P, Thiran J, Meuli R, Cuadra M . An efficient total variation algorithm for super-resolution in fetal brain MRI with adaptive regularization. Neuroimage. 2015; 118:584-97. DOI: 10.1016/j.neuroimage.2015.06.018. View

10.

Gholipour A, Estroff J, Warfield S . Robust super-resolution volume reconstruction from slice acquisitions: application to fetal brain MRI. IEEE Trans Med Imaging. 2010; 29(10):1739-58. PMC: 3694441. DOI: 10.1109/TMI.2010.2051680. View

11.

Laidlaw D, Fleischer K, Barr A . Partial-volume Bayesian classification of material mixtures in MR volume data using voxel histograms. IEEE Trans Med Imaging. 1998; 17(1):74-86. DOI: 10.1109/42.668696. View

12.

Perez-Garcia F, Sparks R, Ourselin S . TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning. Comput Methods Programs Biomed. 2021; 208:106236. PMC: 8542803. DOI: 10.1016/j.cmpb.2021.106236. View

13.

Wang Z, Bovik A, Sheikh H, Simoncelli E . Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 2004; 13(4):600-12. DOI: 10.1109/tip.2003.819861. View

14.

Hoffmann M, Abaci Turk E, Gagoski B, Morgan L, Wighton P, Tisdall M . Rapid head-pose detection for automated slice prescription of fetal-brain MRI. Int J Imaging Syst Technol. 2021; 31(3):1136-1154. PMC: 8372849. DOI: 10.1002/ima.22563. View

15.

Xu J, Abaci Turk E, Grant P, Golland P, Adalsteinsson E . STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning. Med Image Comput Comput Assist Interv. 2023; 12907:197-206. PMC: 10129053. DOI: 10.1007/978-3-030-87234-2_19. View

16.

Ebner M, Wang G, Li W, Aertsen M, Patel P, Aughwane R . An automated framework for localization, segmentation and super-resolution reconstruction of fetal brain MRI. Neuroimage. 2019; 206:116324. PMC: 7103783. DOI: 10.1016/j.neuroimage.2019.116324. View

17.

Kuklisova-Murgasova M, Quaghebeur G, Rutherford M, Hajnal J, Schnabel J . Reconstruction of fetal brain MRI with intensity matching and complete outlier removal. Med Image Anal. 2012; 16(8):1550-64. PMC: 4067058. DOI: 10.1016/j.media.2012.07.004. View

18.

Gagoski B, Xu J, Wighton P, Tisdall M, Frost R, Lo W . Automated detection and reacquisition of motion-degraded images in fetal HASTE imaging at 3 T. Magn Reson Med. 2021; 87(4):1914-1922. PMC: 8810713. DOI: 10.1002/mrm.29106. View

19.

Gudbjartsson H, Patz S . The Rician distribution of noisy MRI data. Magn Reson Med. 1995; 34(6):910-4. PMC: 2254141. DOI: 10.1002/mrm.1910340618. View

20.

Xu J, Lala S, Gagoski B, Abaci Turk E, Grant P, Golland P . Semi-Supervised Learning for Fetal Brain MRI Quality Assessment with ROI consistency. Med Image Comput Comput Assist Interv. 2022; 12266:386-395. PMC: 9652031. DOI: 10.1007/978-3-030-59725-2_37. View