» Articles » PMID: 39338721

FusionOpt-Net: A Transformer-Based Compressive Sensing Reconstruction Algorithm

Overview
Journal Sensors (Basel)
Publisher MDPI
Specialty Biotechnology
Date 2024 Sep 28
PMID 39338721
Authors
Affiliations
Soon will be listed here.
Abstract

Compressive sensing (CS) is a notable technique in signal processing, especially in multimedia, as it allows for simultaneous signal acquisition and dimensionality reduction. Recent advancements in deep learning (DL) have led to the creation of deep unfolding architectures, which overcome the inefficiency and subpar quality of traditional CS reconstruction methods. In this paper, we introduce a novel CS image reconstruction algorithm that leverages the strengths of the fast iterative shrinkage-thresholding algorithm (FISTA) and modern Transformer networks. To enhance computational efficiency, we employ a block-based sampling approach in the sampling module. By mapping FISTA's iterative process onto neural networks in the reconstruction module, we address the hyperparameter challenges of traditional algorithms, thereby improving reconstruction efficiency. Moreover, the robust feature extraction capabilities of Transformer networks significantly enhance image reconstruction quality. Experimental results show that the FusionOpt-Net model surpasses other advanced methods on various public benchmark datasets.

References
1.
Ye D, Ni Z, Wang H, Zhang J, Wang S, Kwong S . CSformer: Bridging Convolution and Transformer for Compressive Sensing. IEEE Trans Image Process. 2023; 32:2827-2842. DOI: 10.1109/TIP.2023.3274988. View

2.
Donoho D, Maleki A, Montanari A . Message-passing algorithms for compressed sensing. Proc Natl Acad Sci U S A. 2009; 106(45):18914-9. PMC: 2767368. DOI: 10.1073/pnas.0909892106. View

3.
Yang Y, Sun J, Li H, Xu Z . ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing. IEEE Trans Pattern Anal Mach Intell. 2018; 42(3):521-538. DOI: 10.1109/TPAMI.2018.2883941. View

4.
Bindels D, Haarbosch L, van Weeren L, Postma M, Wiese K, Mastop M . mScarlet: a bright monomeric red fluorescent protein for cellular imaging. Nat Methods. 2016; 14(1):53-56. DOI: 10.1038/nmeth.4074. View

5.
Zhang Z, Liu Y, Liu J, Wen F, Zhu C . AMP-Net: Denoising-Based Deep Unfolding for Compressive Image Sensing. IEEE Trans Image Process. 2020; 30:1487-1500. DOI: 10.1109/TIP.2020.3044472. View