Integrated 3d Flow-based Multi-atlas Brain Structure Segmentation

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2022 Aug 15

PMID 35969596

Authors

Yeshu Li

Ziming Qiu

Xingyu Fan

Xianglong Liu

Eric I-Chao Chang

Yan Xu

Affiliations

Soon will be listed here.

Abstract

MRI brain structure segmentation plays an important role in neuroimaging studies. Existing methods either spend much CPU time, require considerable annotated data, or fail in segmenting volumes with large deformation. In this paper, we develop a novel multi-atlas-based algorithm for 3D MRI brain structure segmentation. It consists of three modules: registration, atlas selection and label fusion. Both registration and label fusion leverage an integrated flow based on grayscale and SIFT features. We introduce an effective and efficient strategy for atlas selection by employing the accompanying energy generated in the registration step. A 3D sequential belief propagation method and a 3D coarse-to-fine flow matching approach are developed in both registration and label fusion modules. The proposed method is evaluated on five public datasets. The results show that it has the best performance in almost all the settings compared to competitive methods such as ANTs, Elastix, Learning to Rank and Joint Label Fusion. Moreover, our registration method is more than 7 times as efficient as that of ANTs SyN, while our label transfer method is 18 times faster than Joint Label Fusion in CPU time. The results on the ADNI dataset demonstrate that our method is applicable to image pairs that require a significant transformation in registration. The performance on a composite dataset suggests that our method succeeds in a cross-modality manner. The results of this study show that the integrated 3D flow-based method is effective and efficient for brain structure segmentation. It also demonstrates the power of SIFT features, multi-atlas segmentation and classical machine learning algorithms for a medical image analysis task. The experimental results on public datasets show the proposed method's potential for general applicability in various brain structures and settings.

References

Jeneson A, Squire L . Working memory, long-term memory, and medial temporal lobe function. Learn Mem. 2011; 19(1):15-25. PMC: 3246590. DOI: 10.1101/lm.024018.111. View

Burgess N, Maguire E, OKeefe J . The human hippocampus and spatial and episodic memory. Neuron. 2002; 35(4):625-41. DOI: 10.1016/s0896-6273(02)00830-9. View

Asman A, Landman B . Non-local statistical label fusion for multi-atlas segmentation. Med Image Anal. 2012; 17(2):194-208. PMC: 3648421. DOI: 10.1016/j.media.2012.10.002. View

Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A . A comparative study of energy minimization methods for Markov random fields with smoothness-based priors. IEEE Trans Pattern Anal Mach Intell. 2008; 30(6):1068-80. DOI: 10.1109/TPAMI.2007.70844. View

Pipitone J, Park M, Winterburn J, Lett T, Lerch J, Pruessner J . Multi-atlas segmentation of the whole hippocampus and subfields using multiple automatically generated templates. Neuroimage. 2014; 101:494-512. DOI: 10.1016/j.neuroimage.2014.04.054. View

Yushkevich P, Piven J, Hazlett H, Smith R, Ho S, Gee J . User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage. 2006; 31(3):1116-28. DOI: 10.1016/j.neuroimage.2006.01.015. View

Marcus D, Wang T, Parker J, Csernansky J, Morris J, Buckner R . Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. J Cogn Neurosci. 2007; 19(9):1498-507. DOI: 10.1162/jocn.2007.19.9.1498. View

Steve T, Yasuda C, Coras R, Lail M, Blumcke I, Livy D . Development of a histologically validated segmentation protocol for the hippocampal body. Neuroimage. 2017; 157:219-232. DOI: 10.1016/j.neuroimage.2017.06.008. View

Sabuncu M, Yeo B, Van Leemput K, Fischl B, Golland P . A generative model for image segmentation based on label fusion. IEEE Trans Med Imaging. 2010; 29(10):1714-29. PMC: 3268159. DOI: 10.1109/TMI.2010.2050897. View

10.

Klein S, Staring M, Murphy K, Viergever M, Pluim J . elastix: a toolbox for intensity-based medical image registration. IEEE Trans Med Imaging. 2009; 29(1):196-205. DOI: 10.1109/TMI.2009.2035616. View

11.

Iosifescu D, Shenton M, Warfield S, Kikinis R, Dengler J, Jolesz F . An automated registration algorithm for measuring MRI subcortical brain structures. Neuroimage. 1997; 6(1):13-25. DOI: 10.1006/nimg.1997.0274. View

12.

Ding Z, Han X, Niethammer M . VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentation. Med Image Comput Comput Assist Interv. 2022; 11766:202-210. PMC: 9450564. DOI: 10.1007/978-3-030-32248-9_23. View

13.

Langerak T, van der Heide U, Kotte A, Viergever M, van Vulpen M, Pluim J . Label fusion in atlas-based segmentation using a selective and iterative method for performance level estimation (SIMPLE). IEEE Trans Med Imaging. 2010; 29(12):2000-8. DOI: 10.1109/TMI.2010.2057442. View

14.

Lotjonen J, Wolz R, Koikkalainen J, Thurfjell L, Waldemar G, Soininen H . Fast and robust multi-atlas segmentation of brain magnetic resonance images. Neuroimage. 2009; 49(3):2352-65. DOI: 10.1016/j.neuroimage.2009.10.026. View

15.

Warfield S, Zou K, Wells W . Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imaging. 2004; 23(7):903-21. PMC: 1283110. DOI: 10.1109/TMI.2004.828354. View

16.

Kolmogorov V . Convergent tree-reweighted message passing for energy minimization. IEEE Trans Pattern Anal Mach Intell. 2006; 28(10):1568-83. DOI: 10.1109/TPAMI.2006.200. View

17.

Carbon M, Ma Y, Barnes A, Dhawan V, Chaly T, Ghilardi M . Caudate nucleus: influence of dopaminergic input on sequence learning and brain activation in Parkinsonism. Neuroimage. 2004; 21(4):1497-507. DOI: 10.1016/j.neuroimage.2003.12.014. View

18.

Hammers A, Allom R, Koepp M, Free S, Myers R, Lemieux L . Three-dimensional maximum probability atlas of the human brain, with particular reference to the temporal lobe. Hum Brain Mapp. 2003; 19(4):224-47. PMC: 6871794. DOI: 10.1002/hbm.10123. View

19.

Wang H, Suh J, Das S, Pluta J, Craige C, Yushkevich P . Multi-Atlas Segmentation with Joint Label Fusion. IEEE Trans Pattern Anal Mach Intell. 2012; 35(3):611-23. PMC: 3864549. DOI: 10.1109/TPAMI.2012.143. View

20.

Sabuncu M, Desikan R, Sepulcre J, Yeo B, Liu H, Schmansky N . The dynamics of cortical and hippocampal atrophy in Alzheimer disease. Arch Neurol. 2011; 68(8):1040-8. PMC: 3248949. DOI: 10.1001/archneurol.2011.167. View