» Articles » PMID: 39233889

Iteratively Refined Image Reconstruction with Learned Attentive Regularizers

Overview
Date 2024 Sep 5
PMID 39233889
Authors
Affiliations
Soon will be listed here.
Abstract

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze theoretically. In contrast, our scheme is interpretable because it corresponds to the minimization of a series of convex problems. For each problem in the series, a mask is generated based on the previous solution to refine the regularization strength spatially. In this way, the model becomes progressively attentive to the image structure. For the underlying update operator, we prove the existence of a fixed point. As a special case, we investigate a mask generator for which the fixed-point iterations converge to a critical point of an explicit energy functional. In our experiments, we match the performance of state-of-the-art learned variational models for the solution of inverse problems. Additionally, we offer a promising balance between interpretability, theoretical guarantees, reliability, and performance.

References
1.
Beck A, Teboulle M . Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans Image Process. 2009; 18(11):2419-34. DOI: 10.1109/TIP.2009.2028250. View

2.
Knoll F, Zbontar J, Sriram A, Muckley M, Bruno M, Defazio A . fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning. Radiol Artif Intell. 2020; 2(1):e190007. PMC: 6996599. DOI: 10.1148/ryai.2020190007. View

3.
Lefkimmiatis S, Bourquard A, Unser M . Hessian-based norm regularization for image restoration with biomedical applications. IEEE Trans Image Process. 2011; 21(3):983-95. DOI: 10.1109/TIP.2011.2168232. View

4.
Dabov K, Foi A, Katkovnik V, Egiazarian K . Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process. 2007; 16(8):2080-95. DOI: 10.1109/tip.2007.901238. View

5.
Uecker M, Lai P, Murphy M, Virtue P, Elad M, Pauly J . ESPIRiT--an eigenvalue approach to autocalibrating parallel MRI: where SENSE meets GRAPPA. Magn Reson Med. 2013; 71(3):990-1001. PMC: 4142121. DOI: 10.1002/mrm.24751. View