POCS-Augmented CycleGAN for MR Image Reconstruction

Overview

Journal Appl Sci (Basel)

Date 2023 Jul 19

PMID 37465648

Authors

Yiran Li

Hanlu Yang

Danfeng Xie

David Dreizin

Fuqing Zhou

Ze Wang

Affiliations

Soon will be listed here.

Abstract

Recent years have seen increased research interest in replacing the computationally intensive Magnetic resonance (MR) image reconstruction process with deep neural networks. We claim in this paper that the traditional image reconstruction methods and deep learning (DL) are mutually complementary and can be combined to achieve better image reconstruction quality. To test this hypothesis, a hybrid DL image reconstruction method was proposed by combining a state-of-the-art deep learning network, namely a generative adversarial network with cycle loss (CycleGAN), with a traditional data reconstruction algorithm: Projection Onto Convex Set (POCS). The output of the first iteration's training results of the CycleGAN was updated by POCS and used as the extra training data for the second training iteration of the CycleGAN. The method was validated using sub-sampled Magnetic resonance imaging data. Compared with other state-of-the-art, DL-based methods (e.g., U-Net, GAN, and RefineGAN) and a traditional method (compressed sensing), our method showed the best reconstruction results.

References

LeCun Y, Bengio Y, Hinton G . Deep learning. Nature. 2015; 521(7553):436-44. DOI: 10.1038/nature14539. View

Sodickson D, Manning W . Simultaneous acquisition of spatial harmonics (SMASH): fast imaging with radiofrequency coil arrays. Magn Reson Med. 1997; 38(4):591-603. DOI: 10.1002/mrm.1910380414. View

McGibney G, Smith M, Nichols S, Crawley A . Quantitative evaluation of several partial Fourier reconstruction algorithms used in MRI. Magn Reson Med. 1993; 30(1):51-9. DOI: 10.1002/mrm.1910300109. View

Pruessmann K, Weiger M, Scheidegger M, Boesiger P . SENSE: sensitivity encoding for fast MRI. Magn Reson Med. 1999; 42(5):952-62. View

Schlemper J, Caballero J, Hajnal J, Price A, Rueckert D . A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction. IEEE Trans Med Imaging. 2017; 37(2):491-503. DOI: 10.1109/TMI.2017.2760978. View

Minh Quan T, Nguyen-Duc T, Jeong W . Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss. IEEE Trans Med Imaging. 2018; 37(6):1488-1497. DOI: 10.1109/TMI.2018.2820120. View

Samsonov A, Kholmovski E, Parker D, Johnson C . POCSENSE: POCS-based reconstruction for sensitivity encoded magnetic resonance imaging. Magn Reson Med. 2004; 52(6):1397-406. DOI: 10.1002/mrm.20285. View

Wang Z, Bovik A, Sheikh H, Simoncelli E . Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 2004; 13(4):600-12. DOI: 10.1109/tip.2003.819861. View

Hyun C, Kim H, Lee S, Lee S, Seo J . Deep learning for undersampled MRI reconstruction. Phys Med Biol. 2018; 63(13):135007. DOI: 10.1088/1361-6560/aac71a. View

10.

Wang Z, Fernandez-Seara M . 2D partially parallel imaging with k-space surrounding neighbors-based data reconstruction. Magn Reson Med. 2006; 56(6):1389-96. DOI: 10.1002/mrm.21078. View

11.

Hammernik K, Klatzer T, Kobler E, Recht M, Sodickson D, Pock T . Learning a variational network for reconstruction of accelerated MRI data. Magn Reson Med. 2017; 79(6):3055-3071. PMC: 5902683. DOI: 10.1002/mrm.26977. View

12.

Griswold M, Jakob P, Heidemann R, Nittka M, Jellus V, Wang J . Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn Reson Med. 2002; 47(6):1202-10. DOI: 10.1002/mrm.10171. View

13.

Keegan J, Slabaugh G, Arridge S, Ye X, Guo Y, Yu S . DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction. IEEE Trans Med Imaging. 2018; 37(6):1310-1321. DOI: 10.1109/TMI.2017.2785879. View

14.

Twieg D . The k-trajectory formulation of the NMR imaging process with applications in analysis and synthesis of imaging methods. Med Phys. 1983; 10(5):610-21. DOI: 10.1118/1.595331. View

15.

Dreizin D, Zhou Y, Fu S, Wang Y, Li G, Champ K . A Multiscale Deep Learning Method for Quantitative Visualization of Traumatic Hemoperitoneum at CT: Assessment of Feasibility and Comparison with Subjective Categorical Estimation. Radiol Artif Intell. 2020; 2(6):e190220. PMC: 7706875. DOI: 10.1148/ryai.2020190220. View

16.

Wang Z, Wang J, Detre J . Improved data reconstruction method for GRAPPA. Magn Reson Med. 2005; 54(3):738-42. DOI: 10.1002/mrm.20601. View

17.

Wang S, Su Z, Ying L, Peng X, Zhu S, Liang F . ACCELERATING MAGNETIC RESONANCE IMAGING VIA DEEP LEARNING. Proc IEEE Int Symp Biomed Imaging. 2019; 2016:514-517. PMC: 6839781. DOI: 10.1109/ISBI.2016.7493320. View

18.

Zhang L, Xie D, Li Y, Camargo A, Song D, Lu T . Improving Sensitivity of Arterial Spin Labeling Perfusion MRI in Alzheimer's Disease Using Transfer Learning of Deep Learning-Based ASL Denoising. J Magn Reson Imaging. 2021; 55(6):1710-1722. PMC: 9072602. DOI: 10.1002/jmri.27984. View

19.

Li Y, Xie D, Cember A, Nanga R, Yang H, Kumar D . Accelerating GluCEST imaging using deep learning for B correction. Magn Reson Med. 2020; 84(4):1724-1733. PMC: 8082274. DOI: 10.1002/mrm.28289. View