3D Virtual Pancreatography

Overview

Journal IEEE Trans Vis Comput Graph

Specialty Medical Informatics

Date 2020 Sep 2

PMID 32870794

Citations 3

Authors

Shreeraj Jadhav

Konstantin Dmitriev

Joseph Marino

Matthew Barish

Arie E Kaufman

Affiliations

Soon will be listed here.

Abstract

We present 3D virtual pancreatography (VP), a novel visualization procedure and application for non-invasive diagnosis and classification of pancreatic lesions, the precursors of pancreatic cancer. Currently, non-invasive screening of patients is performed through visual inspection of 2D axis-aligned CT images, though the relevant features are often not clearly visible nor automatically detected. VP is an end-to-end visual diagnosis system that includes: A machine learning based automatic segmentation of the pancreatic gland and the lesions, a semi-automatic approach to extract the primary pancreatic duct, a machine learning based automatic classification of lesions into four prominent types, and specialized 3D and 2D exploratory visualizations of the pancreas, lesions and surrounding anatomy. We combine volume rendering with pancreas- and lesion-centric visualizations and measurements for effective diagnosis. We designed VP through close collaboration and feedback from expert radiologists, and evaluated it on multiple real-world CT datasets with various pancreatic lesions and case studies examined by the expert radiologists.

Citing Articles

Artificial Intelligence in Pancreatic Intraductal Papillary Mucinous Neoplasm Imaging: A Systematic Review.

Qadir M, Baril J, Yip-Schneider M, Schonlau D, Tran T, Schmidt C medRxiv. 2025; .

PMID: 39830259 PMC: 11741484. DOI: 10.1101/2025.01.08.25320130.

Centerline-guided reinforcement learning model for pancreatic duct identifications.

Amiri S, Karimzadeh R, Vrtovec T, Gudmann Steuble Brandt E, Thomsen H, Brun Andersen M J Med Imaging (Bellingham). 2024; 11(6):064002.

PMID: 39525832 PMC: 11543826. DOI: 10.1117/1.JMI.11.6.064002.

Artificial intelligence in pancreatic cancer.

Huang B, Huang H, Zhang S, Zhang D, Shi Q, Liu J Theranostics. 2022; 12(16):6931-6954.

PMID: 36276650 PMC: 9576619. DOI: 10.7150/thno.77949.

COVID-view: Diagnosis of COVID-19 using Chest CT.

Jadhav S, Deng G, Zawin M, Kaufman A IEEE Trans Vis Comput Graph. 2021; 28(1):227-237.

PMID: 34587075 PMC: 8981756. DOI: 10.1109/TVCG.2021.3114851.

References

Daae Lampe O, Correa C, Ma K, Hauser H . Curve-centric volume reformation for comparative visualization. IEEE Trans Vis Comput Graph. 2009; 15(6):1235-42. DOI: 10.1109/TVCG.2009.136. View

Mirhosseini S, Gutenko I, Ojal S, Marino J, Kaufman A . Immersive Virtual Colonoscopy. IEEE Trans Vis Comput Graph. 2019; 25(5):2011-2021. DOI: 10.1109/TVCG.2019.2898763. View

Wang J, Yang X, Cai H, Tan W, Jin C, Li L . Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning. Sci Rep. 2016; 6:27327. PMC: 4895132. DOI: 10.1038/srep27327. View

Yin T, Coudyzer W, Peeters R, Liu Y, Miranda Cona M, Feng Y . Three-dimensional contrasted visualization of pancreas in rats using clinical MRI and CT scanners. Contrast Media Mol Imaging. 2015; 10(5):379-87. DOI: 10.1002/cmmi.1640. View

Fridman Y, Pizer S, Aylward S, Bullitt E . Extracting branching tubular object geometry via cores. Med Image Anal. 2004; 8(3):169-76. DOI: 10.1016/j.media.2004.06.017. View

Nadeem S, Marino J, Gu X, Kaufman A . Corresponding Supine and Prone Colon Visualization Using Eigenfunction Analysis and Fold Modeling. IEEE Trans Vis Comput Graph. 2016; 23(1):751-760. PMC: 7812443. DOI: 10.1109/TVCG.2016.2598791. View

Okada T, Linguraru M, Hori M, Summers R, Tomiyama N, Sato Y . Abdominal multi-organ segmentation from CT images using conditional shape-location and unsupervised intensity priors. Med Image Anal. 2015; 26(1):1-18. PMC: 4679509. DOI: 10.1016/j.media.2015.06.009. View

Wolz R, Chu C, Misawa K, Mori K, Rueckert D . Multi-organ abdominal CT segmentation using hierarchically weighted subject-specific atlases. Med Image Comput Comput Assist Interv. 2013; 15(Pt 1):10-7. DOI: 10.1007/978-3-642-33415-3_2. View

Sato Y, Nakajima S, Shiraga N, Atsumi H, Yoshida S, Koller T . Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. Med Image Anal. 2000; 2(2):143-68. DOI: 10.1016/s1361-8415(98)80009-1. View

10.

Cai J, Lu L, Zhang Z, Xing F, Yang L, Yin Q . Pancreas Segmentation in MRI using Graph-Based Decision Fusion on Convolutional Neural Networks. Med Image Comput Comput Assist Interv. 2017; 9901:442-450. PMC: 5223591. DOI: 10.1007/978-3-319-46723-8_51. View

11.

Rodenwaldt J, Kopka L, Roedel R, Margas A, Grabbe E . 3D virtual endoscopy of the upper airway: optimization of the scan parameters in a cadaver phantom and clinical assessment. J Comput Assist Tomogr. 1997; 21(3):405-11. DOI: 10.1097/00004728-199705000-00013. View

12.

Auzinger T, Mistelbauer G, Baclija I, Schernthaner R, Kochl A, Wimmer M . Vessel visualization using curved surface reformation. IEEE Trans Vis Comput Graph. 2013; 19(12):2858-67. DOI: 10.1109/TVCG.2013.215. View

13.

Ghaderi M, Heydarzadeh M, Nourani M, Gupta G, Tamil L . Augmented reality for breast tumors visualization. Annu Int Conf IEEE Eng Med Biol Soc. 2017; 2016:4391-4394. DOI: 10.1109/EMBC.2016.7591700. View

14.

Smit N, Lawonn K, Kraima A, DeRuiter M, Sokooti H, Bruckner S . PelVis: Atlas-based Surgical Planning for Oncological Pelvic Surgery. IEEE Trans Vis Comput Graph. 2016; 23(1):741-750. DOI: 10.1109/TVCG.2016.2598826. View

15.

Li H, Shi K, Reichert M, Lin K, Tselousov N, Braren R . Differential Diagnosis for Pancreatic Cysts in CT Scans Using Densely-Connected Convolutional Networks. Annu Int Conf IEEE Eng Med Biol Soc. 2020; 2019:2095-2098. DOI: 10.1109/EMBC.2019.8856745. View

16.

Cho H, Choi J, Kim M, Park M, Lim J, Chung Y . Pancreatic tumors: emphasis on CT findings and pathologic classification. Korean J Radiol. 2011; 12(6):731-9. PMC: 3194778. DOI: 10.3348/kjr.2011.12.6.731. View

17.

Chu C, Oda M, Kitasaka T, Misawa K, Fujiwara M, Hayashi Y . Multi-organ segmentation based on spatially-divided probabilistic atlas from 3D abdominal CT images. Med Image Comput Comput Assist Interv. 2014; 16(Pt 2):165-72. DOI: 10.1007/978-3-642-40763-5_21. View

18.

Kretschmer J, Soza G, Tietjen C, Suehling M, Preim B, Stamminger M . ADR--Anatomy-Driven Reformation. IEEE Trans Vis Comput Graph. 2015; 20(12):2496-505. DOI: 10.1109/TVCG.2014.2346405. View

19.

Sahani D, Sainani N, Blake M, Crippa S, Mino-Kenudson M, Fernandez Del-Castillo C . Prospective evaluation of reader performance on MDCT in characterization of cystic pancreatic lesions and prediction of cyst biologic aggressiveness. AJR Am J Roentgenol. 2011; 197(1):W53-61. DOI: 10.2214/AJR.10.5866. View

20.

Dmitriev K, Kaufman A, Javed A, Hruban R, Fishman E, Lennon A . Classification of Pancreatic Cysts in Computed Tomography Images Using a Random Forest and Convolutional Neural Network Ensemble. Med Image Comput Comput Assist Interv. 2018; 10435:150-158. PMC: 5987215. DOI: 10.1007/978-3-319-66179-7_18. View