Content-based Medical Image Retrieval: a Survey of Applications to Multidimensional and Multimodality Data

Overview

Journal J Digit Imaging

Publisher Springer

Specialties Medical Informatics
Radiology

Date 2013 Jul 13

PMID 23846532

Citations 23

Authors

Ashnil Kumar

Jinman Kim

Weidong Cai

Michael Fulham

Dagan Feng

Affiliations

Soon will be listed here.

Abstract

Medical imaging is fundamental to modern healthcare, and its widespread use has resulted in the creation of image databases, as well as picture archiving and communication systems. These repositories now contain images from a diverse range of modalities, multidimensional (three-dimensional or time-varying) images, as well as co-aligned multimodality images. These image collections offer the opportunity for evidence-based diagnosis, teaching, and research; for these applications, there is a requirement for appropriate methods to search the collections for images that have characteristics similar to the case(s) of interest. Content-based image retrieval (CBIR) is an image search technique that complements the conventional text-based retrieval of images by using visual features, such as color, texture, and shape, as search criteria. Medical CBIR is an established field of study that is beginning to realize promise when applied to multidimensional and multimodality medical data. In this paper, we present a review of state-of-the-art medical CBIR approaches in five main categories: two-dimensional image retrieval, retrieval of images with three or more dimensions, the use of nonimage data to enhance the retrieval, multimodality image retrieval, and retrieval from diverse datasets. We use these categories as a framework for discussing the state of the art, focusing on the characteristics and modalities of the information used during medical image retrieval.

Citing Articles

Learning to Match 2D Keypoints Across Preoperative MR and Intraoperative Ultrasound.

Rasheed H, Dorent R, Fehrentz M, Morozov D, Kapur T, Wells 3rd W Unknown. 2024; 15186:78-87.

PMID: 39736888 PMC: 11682695. DOI: 10.1007/978-3-031-73647-6_8.

A New Approach for Effective Retrieval of Medical Images: A Step towards Computer-Assisted Diagnosis.

Sharma S, Aggarwal A J Imaging. 2024; 10(9).

PMID: 39330430 PMC: 11433568. DOI: 10.3390/jimaging10090210.

On image search in histopathology.

Tizhoosh H, Pantanowitz L J Pathol Inform. 2024; 15:100375.

PMID: 38645985 PMC: 11033156. DOI: 10.1016/j.jpi.2024.100375.

Novel in-house knowledge-based automated planning system for lung cancer treated with intensity-modulated radiotherapy.

Shao Y, Guo J, Wang J, Huang Y, Gan W, Zhang X Strahlenther Onkol. 2023; 200(11):967-982.

PMID: 37603050 PMC: 11527916. DOI: 10.1007/s00066-023-02126-1.

Improving the Automatic Classification of Brain MRI Acquisition Contrast with Machine Learning.

Cluceru J, Lupo J, Interian Y, Bove R, Crane J J Digit Imaging. 2022; 36(1):289-305.

PMID: 35941406 PMC: 9984597. DOI: 10.1007/s10278-022-00690-z.

References

Doi K . Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph. 2007; 31(4-5):198-211. PMC: 1955762. DOI: 10.1016/j.compmedimag.2007.02.002. View

Xu X, Lee D, Antani S, Long L . A spine X-ray image retrieval system using partial shape matching. IEEE Trans Inf Technol Biomed. 2008; 12(1):100-8. DOI: 10.1109/TITB.2007.904149. View

Kumar A, Kim J, Cai W, Eberl S, Feng D . A graph-based approach to the retrieval of dual-modality biomedical images using spatial relationships. Annu Int Conf IEEE Eng Med Biol Soc. 2009; 2008:390-3. DOI: 10.1109/IEMBS.2008.4649172. View

Zhou X, Stern R, Muller H . Case-based fracture image retrieval. Int J Comput Assist Radiol Surg. 2011; 7(3):401-11. DOI: 10.1007/s11548-011-0643-8. View

Quellec G, Lamard M, Bekri L, Cazuguel G, Roux C, Cochener B . Medical case retrieval from a committee of decision trees. IEEE Trans Inf Technol Biomed. 2010; 14(5):1227-35. DOI: 10.1109/TITB.2010.2053716. View

Akakin H, Gurcan M . Content-based microscopic image retrieval system for multi-image queries. IEEE Trans Inf Technol Biomed. 2012; 16(4):758-69. PMC: 3389578. DOI: 10.1109/TITB.2012.2185829. View

Long L, Antani S, Deserno T, Thoma G . Content-Based Image Retrieval in Medicine: Retrospective Assessment, State of the Art, and Future Directions. Int J Healthc Inf Syst Inform. 2011; 4(1):1-16. PMC: 2879660. DOI: 10.4018/jhisi.2009010101. View

Napel S, Beaulieu C, Rodriguez C, Cui J, Xu J, Gupta A . Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. Radiology. 2010; 256(1):243-52. PMC: 2897688. DOI: 10.1148/radiol.10091694. View

Guld M, Thies C, Fischer B, Lehmann T . A generic concept for the implementation of medical image retrieval systems. Int J Med Inform. 2006; 76(2-3):252-9. DOI: 10.1016/j.ijmedinf.2006.02.011. View

10.

Townsend D, Beyer T . A combined PET/CT scanner: the path to true image fusion. Br J Radiol. 2003; 75 Spec No:S24-30. DOI: 10.1259/bjr.75.suppl_9.750024. View

11.

Robson Brown K, Silver I, Musgrave J, Roberts A . The use of μCT technology to identify skull fracture in a case involving blunt force trauma. Forensic Sci Int. 2010; 206(1-3):e8-11. DOI: 10.1016/j.forsciint.2010.06.013. View

12.

Unay D, Ekin A, Jasinschi R . Local structure-based region-of-interest retrieval in brain MR images. IEEE Trans Inf Technol Biomed. 2010; 14(4):897-903. DOI: 10.1109/TITB.2009.2038152. View

13.

Aisen A, Broderick L, Winer-Muram H, Brodley C, Kak A, Pavlopoulou C . Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology. 2003; 228(1):265-70. DOI: 10.1148/radiol.2281020126. View

14.

Townsend D, Beyer T, Blodgett T . PET/CT scanners: a hardware approach to image fusion. Semin Nucl Med. 2003; 33(3):193-204. DOI: 10.1053/snuc.2003.127314. View

15.

Long L, Antani S, Thoma G . Image informatics at a national research center. Comput Med Imaging Graph. 2005; 29(2-3):171-93. DOI: 10.1016/j.compmedimag.2004.09.015. View

16.

Quellec G, Lamard M, Cazuguel G, Cochener B, Roux C . Wavelet optimization for content-based image retrieval in medical databases. Med Image Anal. 2009; 14(2):227-41. DOI: 10.1016/j.media.2009.11.004. View

17.

Spitzer V, Ackerman M, Scherzinger A, Whitlock D . The visible human male: a technical report. J Am Med Inform Assoc. 1996; 3(2):118-30. PMC: 116294. DOI: 10.1136/jamia.1996.96236280. View

18.

Akgul C, Rubin D, Napel S, Beaulieu C, Greenspan H, Acar B . Content-based image retrieval in radiology: current status and future directions. J Digit Imaging. 2010; 24(2):208-22. PMC: 3056970. DOI: 10.1007/s10278-010-9290-9. View

19.

Blodgett T, Meltzer C, Townsend D . PET/CT: form and function. Radiology. 2007; 242(2):360-85. DOI: 10.1148/radiol.2422051113. View

20.

Qian X, Tagare H, Fulbright R, Long R, Antani S . Optimal embedding for shape indexing in medical image databases. Med Image Anal. 2010; 14(3):243-54. PMC: 2854880. DOI: 10.1016/j.media.2010.01.001. View