Image Fusion Using Hybrid Methods in Multimodality Medical Images

Overview

Journal Med Biol Eng Comput

Publisher Springer

Specialties Biomedical Engineering
Medical Informatics

Date 2020 Jan 30

PMID 31993885

Citations 19

Authors

Satya Prakash Yadav

Sachin Yadav

Affiliations

Soon will be listed here.

Abstract

An image fusion based on multimodal medical images renders a considerable enhancement in the quality of fused images. An effective image fusion technique produces output images by preserving all the viable and prominent information gathered from the source images without any introduction of flaws or unnecessary distortions. This review paper intends to bring out the process of image fusion, its utilization in the medical domain, merits, and demerits and reviews the perspective of multimodal medical image fusion. It also discusses the involvement of various medical entities like medical resonance imaging (MRI), positron emission tomography (PET), and computed tomography (CT). The usefulness of such modalities is presented, suggesting plausible hybrid modality combinations which could greatly enhance image fusion. This review also discusses innovative dispositions in the medical image fusion techniques for the achievement of incisively desired, quality images focused on fusion with wavelet transform and use of independent component analysis (ICA) and principal component analysis (PCA) techniques for the purpose denoising and data dimension reductions. Additionally, the future-prospects of an ideal technique for medical image fusion through the utilization of various medical modalities have been also discussed in this review paper. Graphical abstract.

Citing Articles

A novel MRI PET image fusion using shearlet transform and pulse coded neural network.

Satyanarayana V, Mohanaiah P Sci Rep. 2025; 15(1):6349.

PMID: 39984532 PMC: 11845506. DOI: 10.1038/s41598-025-88701-1.

Image fusion for intraoperative evaluation of microwave ablation in non-small cell lung cancer: a retrospective cohort study.

Yang X, Tang W, Yuan Z, Wang M, Liang X Quant Imaging Med Surg. 2024; 14(12):9207-9219.

PMID: 39698722 PMC: 11652049. DOI: 10.21037/qims-24-690.

An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19.

Allapakam V, Karuna Y PLoS One. 2024; 19(10):e0309651.

PMID: 39441782 PMC: 11498686. DOI: 10.1371/journal.pone.0309651.

A review of deep learning approaches for multimodal image segmentation of liver cancer.

Wu C, Chen Q, Wang H, Guan Y, Mian Z, Huang C J Appl Clin Med Phys. 2024; 25(12):e14540.

PMID: 39374312 PMC: 11633801. DOI: 10.1002/acm2.14540.

A Review of EEG-based Localization of Epileptic Seizure Foci: Common Points with Multimodal Fusion of Brain Data.

Tajmirriahi M, Rabbani H J Med Signals Sens. 2024; 14:19.

PMID: 39234592 PMC: 11373807. DOI: 10.4103/jmss.jmss_11_24.

References

Guo Q, Dong F, Sun S, Lei B, Gao B . Image denoising algorithm based on contourlet transform for optical coherence tomography heart tube image. IET Image Process. 2016; 7(5):442-450. PMC: 4833027. DOI: 10.1049/iet-ipr.2013.0127. View

Duarte G, Cabello C, Torresan R, Alvarenga M, Telles G, Bianchessi S . Fusion of magnetic resonance and scintimammography images for breast cancer evaluation: a pilot study. Ann Surg Oncol. 2007; 14(10):2903-10. DOI: 10.1245/s10434-007-9476-7. View

Aklan B, Paulus D, Wenkel E, Braun H, Navalpakkam B, Ziegler S . Toward simultaneous PET/MR breast imaging: systematic evaluation and integration of a radiofrequency breast coil. Med Phys. 2013; 40(2):024301. DOI: 10.1118/1.4788642. View

Amini N, Fatemizadeh E, Behnam H . MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules. J Med Eng Technol. 2014; 38(4):211-9. DOI: 10.3109/03091902.2014.904014. View

Wei H, Viallon M, Delattre B, Moulin K, Yang F, Croisille P . Free-breathing diffusion tensor imaging and tractography of the human heart in healthy volunteers using wavelet-based image fusion. IEEE Trans Med Imaging. 2014; 34(1):306-16. DOI: 10.1109/TMI.2014.2356792. View

Sui J, Adali T, Pearlson G, Yang H, Sponheim S, White T . A CCA+ICA based model for multi-task brain imaging data fusion and its application to schizophrenia. Neuroimage. 2010; 51(1):123-34. PMC: 2847043. DOI: 10.1016/j.neuroimage.2010.01.069. View

Nemec S, Peloschek P, Schmook M, Krestan C, Hauff W, Matula C . CT-MR image data fusion for computer-assisted navigated surgery of orbital tumors. Eur J Radiol. 2008; 73(2):224-9. DOI: 10.1016/j.ejrad.2008.11.003. View

Al-Azzawi N, Sakim H, Abdullah A, Ibrahim H . Medical image fusion scheme using complex contourlet transform based on PCA. Annu Int Conf IEEE Eng Med Biol Soc. 2009; 2009:5813-6. DOI: 10.1109/IEMBS.2009.5335180. View

Bhateja V, Moin A, Srivastava A, Bao L, Lay-Ekuakille A, Le D . Multispectral medical image fusion in Contourlet domain for computer based diagnosis of Alzheimer's disease. Rev Sci Instrum. 2016; 87(7):074303. DOI: 10.1063/1.4959559. View

10.

Geng P, Sun X, Liu J . Adopting Quaternion Wavelet Transform to Fuse Multi-Modal Medical Images. J Med Biol Eng. 2018; 37(2):230-239. PMC: 5928192. DOI: 10.1007/s40846-016-0200-6. View

11.

Singh R, Khare A . Multiscale medical image fusion in wavelet domain. ScientificWorldJournal. 2014; 2013:521034. PMC: 3885318. DOI: 10.1155/2013/521034. View

12.

Mehra I, Nishchal N . Image fusion using wavelet transform and its application to asymmetric cryptosystem and hiding. Opt Express. 2014; 22(5):5474-82. DOI: 10.1364/OE.22.005474. View

13.

Oliveira F, R S Tavares J . Medical image registration: a review. Comput Methods Biomech Biomed Engin. 2012; 17(2):73-93. DOI: 10.1080/10255842.2012.670855. View

14.

Gunzel K, Cash H, Buckendahl J, Konigbauer M, Asbach P, Haas M . The addition of a sagittal image fusion improves the prostate cancer detection in a sensor-based MRI /ultrasound fusion guided targeted biopsy. BMC Urol. 2017; 17(1):7. PMC: 5234255. DOI: 10.1186/s12894-016-0196-9. View

15.

Reena Benjamin J, Jayasree T . Improved medical image fusion based on cascaded PCA and shift invariant wavelet transforms. Int J Comput Assist Radiol Surg. 2017; 13(2):229-240. DOI: 10.1007/s11548-017-1692-4. View

16.

Liu X, Mei W, Du H . Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter. Med Biol Eng Comput. 2018; 56(9):1565-1578. DOI: 10.1007/s11517-018-1796-1. View

17.

Li Y, Verma R . Multichannel image registration by feature-based information fusion. IEEE Trans Med Imaging. 2010; 30(3):707-20. DOI: 10.1109/TMI.2010.2093908. View

18.

Cha D, Lee M, Kim A, Kang T, Oh Y, Jeong J . Automatic image fusion of real-time ultrasound with computed tomography images: a prospective comparison between two auto-registration methods. Acta Radiol. 2017; 58(11):1349-1357. DOI: 10.1177/0284185117693459. View

19.

Salimi-Khorshidi G, Douaud G, Beckmann C, Glasser M, Griffanti L, Smith S . Automatic denoising of functional MRI data: combining independent component analysis and hierarchical fusion of classifiers. Neuroimage. 2014; 90:449-68. PMC: 4019210. DOI: 10.1016/j.neuroimage.2013.11.046. View