Registration of Fluorescein Angiography and Optical Coherence Tomography Images of Curved Retina Via Scanning Laser Ophthalmoscopy Photographs

Overview

Journal Biomed Opt Express

Specialty Radiology

Date 2020 Oct 5

PMID 33014544

Citations 7

Authors

Ramin Almasi

Abbas Vafaei

Zeinab Ghasemi

Mohammad Reza Ommani

Ali Reza Dehghani

Hossein Rabbani

Affiliations

Soon will be listed here.

Abstract

Accurate and automatic registration of multimodal retinal images such as fluorescein angiography (FA) and optical coherence tomography (OCT) enables utilization of supplementary information. FA is a gold standard imaging modality that depicts neurovascular structure of retina and is used for diagnosing neurovascular-related diseases such as diabetic retinopathy (DR). Unlike FA, OCT is non-invasive retinal imaging modality that provides cross-sectional data of retina. Due to differences in contrast, resolution and brightness of multimodal retinal images, the images resulted from vessel extraction of image pairs are not exactly the same. Also, prevalent feature detection, extraction and matching schemes do not result in perfect matches. In addition, the relationships between retinal image pairs are usually modeled by affine transformation, which cannot generate accurate alignments due to the non-planar retina surface. In this paper, a precise registration scheme is proposed to align FA and OCT images via scanning laser ophthalmoscopy (SLO) photographs as intermediate images. For this purpose, first a retinal vessel segmentation is applied to extract main blood vessels from the FA and SLO images. Next, a novel global registration is proposed based on the Gaussian model for curved surface of retina. For doing so, first a global rigid transformation is applied to FA vessel-map image using a new feature-based method to align it with SLO vessel-map photograph, in a way that outlier matched features resulted from not-perfect vessel segmentation are completely eliminated. After that, the transformed image is globally registered again considering Gaussian model for curved surface of retina to improve the precision of the previous step. Eventually a local non-rigid transformation is exploited to register two images perfectly. The experimental results indicate the presented scheme is more precise compared to other registration methods.

Citing Articles

COph100: A comprehensive fundus image registration dataset from infants constituting the "RIDIRP" database.

Hu Y, Gong M, Qiu Z, Liu J, Shen H, Yuan M Sci Data. 2025; 12(1):99.

PMID: 39824846 PMC: 11742693. DOI: 10.1038/s41597-025-04426-w.

Automatic Detection of Microaneurysms in OCT Images Using Bag of Features.

Kazeminasab E, Almasi R, Shoushtarian B, Golkar E, Rabbani H Comput Math Methods Med. 2024; 2022:1233068.

PMID: 39279986 PMC: 11401702. DOI: 10.1155/2022/1233068.

Automated inter-device 3D OCT image registration using deep learning and retinal layer segmentation.

Rivas-Villar D, Motschi A, Pircher M, Hitzenberger C, Schranz M, Roberts P Biomed Opt Express. 2023; 14(7):3726-3747.

PMID: 37497506 PMC: 10368062. DOI: 10.1364/BOE.493047.

Adaptive optics scanning laser ophthalmoscopy and optical coherence tomography (AO-SLO-OCT) system for mouse retina imaging.

Zhang P, Wahl D, Mocci J, Miller E, Bonora S, Sarunic M Biomed Opt Express. 2023; 14(1):299-314.

PMID: 36698677 PMC: 9841993. DOI: 10.1364/BOE.473447.

Automatic detection of microaneurysms in optical coherence tomography images of retina using convolutional neural networks and transfer learning.

Almasi R, Vafaei A, Kazeminasab E, Rabbani H Sci Rep. 2022; 12(1):13975.

PMID: 35978087 PMC: 9385621. DOI: 10.1038/s41598-022-18206-8.

References

Thirion J . Image matching as a diffusion process: an analogy with Maxwell's demons. Med Image Anal. 1999; 2(3):243-60. DOI: 10.1016/s1361-8415(98)80022-4. View

Kafieh R, Rabbani H, Kermani S . A review of algorithms for segmentation of optical coherence tomography from retina. J Med Signals Sens. 2013; 3(1):45-60. PMC: 3785070. View

Bezerra H, Costa M, Guagliumi G, Rollins A, Simon D . Intracoronary optical coherence tomography: a comprehensive review clinical and research applications. JACC Cardiovasc Interv. 2009; 2(11):1035-46. PMC: 4113036. DOI: 10.1016/j.jcin.2009.06.019. View

Kamasi Z, Mokhtari M, Rabbani H . Non-rigid registration of Fluorescein Angiography and Optical Coherence Tomography via scanning laser ophthalmoscope imaging. Annu Int Conf IEEE Eng Med Biol Soc. 2017; 2017:4415-4418. DOI: 10.1109/EMBC.2017.8037835. View

Bolz M, Schmidt-Erfurth U, Deak G, Mylonas G, Kriechbaum K, Scholda C . Optical coherence tomographic hyperreflective foci: a morphologic sign of lipid extravasation in diabetic macular edema. Ophthalmology. 2009; 116(5):914-20. DOI: 10.1016/j.ophtha.2008.12.039. View

Yeung L, Lima V, Garcia P, Landa G, Rosen R . Correlation between spectral domain optical coherence tomography findings and fluorescein angiography patterns in diabetic macular edema. Ophthalmology. 2009; 116(6):1158-67. DOI: 10.1016/j.ophtha.2008.12.063. View

Vercauteren T, Pennec X, Perchant A, Ayache N . Diffeomorphic demons: efficient non-parametric image registration. Neuroimage. 2008; 45(1 Suppl):S61-72. DOI: 10.1016/j.neuroimage.2008.10.040. View

Miri M, Abramoff M, Lee K, Niemeijer M, Wang J, Kwon Y . Multimodal Segmentation of Optic Disc and Cup From SD-OCT and Color Fundus Photographs Using a Machine-Learning Graph-Based Approach. IEEE Trans Med Imaging. 2015; 34(9):1854-66. PMC: 4560662. DOI: 10.1109/TMI.2015.2412881. View

Fraz M, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka A, Owen C . Blood vessel segmentation methodologies in retinal images--a survey. Comput Methods Programs Biomed. 2012; 108(1):407-33. DOI: 10.1016/j.cmpb.2012.03.009. View

10.

Ramli R, Idna Idris M, Hasikin K, Karim N, Abdul Wahab A, Ahmedy I . Feature-Based Retinal Image Registration Using D-Saddle Feature. J Healthc Eng. 2017; 2017:1489524. PMC: 5674727. DOI: 10.1155/2017/1489524. View

11.

Wang H, Chhablani J, Freeman W, Chan C, Kozak I, Bartsch D . Characterization of diabetic microaneurysms by simultaneous fluorescein angiography and spectral-domain optical coherence tomography. Am J Ophthalmol. 2012; 153(5):861-867.e1. PMC: 3331899. DOI: 10.1016/j.ajo.2011.10.005. View

12.

Ma J, Jiang X, Jiang J, Zhao J, Guo X . LMR: Learning a Two-Class Classifier for Mismatch Removal. IEEE Trans Image Process. 2019; 28(8):4045-4059. DOI: 10.1109/TIP.2019.2906490. View

13.

Viergever M, Maintz J, Klein S, Murphy K, Staring M, Pluim J . A survey of medical image registration - under review. Med Image Anal. 2016; 33:140-144. DOI: 10.1016/j.media.2016.06.030. View

14.

Zheng J, Tian J, Dai Y, Deng K, Chen J . Retinal image registration based on salient feature regions. Annu Int Conf IEEE Eng Med Biol Soc. 2009; 2009:102-5. DOI: 10.1109/IEMBS.2009.5334778. View

15.

Yamada Y, Suzuma K, Fujikawa A, Kumagami T, Kitaoka T . Imaging of laser-photocoagulated diabetic microaneurysm with spectral domain optical coherence tomography. Retina. 2013; 33(4):726-31. DOI: 10.1097/IAE.0b013e3182753960. View

16.

Rabbani H, Allingham M, Mettu P, Cousins S, Farsiu S . Fully automatic segmentation of fluorescein leakage in subjects with diabetic macular edema. Invest Ophthalmol Vis Sci. 2015; 56(3):1482-92. PMC: 4347309. DOI: 10.1167/iovs.14-15457. View

17.

Ma J, Jiang X, Jiang J, Guo X . Robust Feature Matching Using Spatial Clustering with Heavy Outliers. IEEE Trans Image Process. 2019; . DOI: 10.1109/TIP.2019.2934572. View

18.

Lee S, Chhablani J, Chan C, Wang H, Barteselli G, El-Emam S . Characterization of microaneurysm closure after focal laser photocoagulation in diabetic macular edema. Am J Ophthalmol. 2013; 155(5):905-12. PMC: 3627831. DOI: 10.1016/j.ajo.2012.12.005. View

19.

Chen J, Tian J, Lee N, Zheng J, Smith R, Laine A . A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Trans Biomed Eng. 2010; 57(7):1707-18. PMC: 3030813. DOI: 10.1109/TBME.2010.2042169. View

20.

Horii T, Murakami T, Nishijima K, Sakamoto A, Ota M, Yoshimura N . Optical coherence tomographic characteristics of microaneurysms in diabetic retinopathy. Am J Ophthalmol. 2010; 150(6):840-8. DOI: 10.1016/j.ajo.2010.06.015. View