Artificial Intelligence in Radiology

Overview

Journal Nat Rev Cancer

Specialty Oncology

Date 2018 May 20

PMID 29777175

Citations 1060

Authors

Ahmed Hosny

Chintan Parmar

John Quackenbush

Lawrence H Schwartz

Hugo J W L Aerts

Affiliations

Soon will be listed here.

Abstract

Artificial intelligence (AI) algorithms, particularly deep learning, have demonstrated remarkable progress in image-recognition tasks. Methods ranging from convolutional neural networks to variational autoencoders have found myriad applications in the medical image analysis field, propelling it forward at a rapid pace. Historically, in radiology practice, trained physicians visually assessed medical images for the detection, characterization and monitoring of diseases. AI methods excel at automatically recognizing complex patterns in imaging data and providing quantitative, rather than qualitative, assessments of radiographic characteristics. In this Opinion article, we establish a general understanding of AI methods, particularly those pertaining to image-based tasks. We explore how these methods could impact multiple facets of radiology, with a general focus on applications in oncology, and demonstrate ways in which these methods are advancing the field. Finally, we discuss the challenges facing clinical implementation and provide our perspective on how the domain could be advanced.

Citing Articles

Deep learning in nuclear medicine: from imaging to therapy.

Zhang M, Liu P, Zhang M, Su P, Shang H, Zhu J Ann Nucl Med. 2025; .

PMID: 40080372 DOI: 10.1007/s12149-025-02031-w.

CT-based radiomics-deep learning model predicts occult lymph node metastasis in early-stage lung adenocarcinoma patients: A multicenter study.

Yin X, Lu Y, Cui Y, Zhou Z, Wen J, Huang Z Chin J Cancer Res. 2025; 37(1):12-27.

PMID: 40078558 PMC: 11893343. DOI: 10.21147/j.issn.1000-9604.2025.01.02.

Enhancing Cancer Screening and Early Diagnosis in India: Overcoming Challenges and Leveraging Emerging Technologies.

Mangayarkarasi V, Durairaj E, Ramanathan V Cureus. 2025; 17(2):e78808.

PMID: 40078237 PMC: 11902917. DOI: 10.7759/cureus.78808.

Comparative Study of AI Modes in Ultrasound Diagnosis of Breast Lesions.

Hong Y, Yu Z, Chou C Diagnostics (Basel). 2025; 15(5).

PMID: 40075807 PMC: 11898511. DOI: 10.3390/diagnostics15050560.

Comparison of radiological interpretation made by veterinary radiologists and state-of-the-art commercial AI software for canine and feline radiographic studies.

Ndiaye Y, Cramton P, Chernev C, Ockenfels A, Schwarz T Front Vet Sci. 2025; 12:1502790.

PMID: 40061904 PMC: 11886591. DOI: 10.3389/fvets.2025.1502790.

References

Shen D, Wu G, Suk H . Deep Learning in Medical Image Analysis. Annu Rev Biomed Eng. 2017; 19:221-248. PMC: 5479722. DOI: 10.1146/annurev-bioeng-071516-044442. View

Cruz-Roa A, Gilmore H, Basavanhally A, Feldman M, Ganesan S, Shih N . Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent. Sci Rep. 2017; 7:46450. PMC: 5394452. DOI: 10.1038/srep46450. View

Shin H, Roth H, Gao M, Lu L, Xu Z, Nogues I . Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. IEEE Trans Med Imaging. 2016; 35(5):1285-98. PMC: 4890616. DOI: 10.1109/TMI.2016.2528162. View

Yang X, Kwitt R, Styner M, Niethammer M . Quicksilver: Fast predictive image registration - A deep learning approach. Neuroimage. 2017; 158:378-396. PMC: 6036629. DOI: 10.1016/j.neuroimage.2017.07.008. View

Kallenberg M, Petersen K, Nielsen M, Ng A, Diao P, Igel C . Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring. IEEE Trans Med Imaging. 2016; 35(5):1322-1331. DOI: 10.1109/TMI.2016.2532122. View

Sharma N, Aggarwal L . Automated medical image segmentation techniques. J Med Phys. 2010; 35(1):3-14. PMC: 2825001. DOI: 10.4103/0971-6203.58777. View

van Ginneken B, Schaefer-Prokop C, Prokop M . Computer-aided diagnosis: how to move from the laboratory to the clinic. Radiology. 2011; 261(3):719-32. DOI: 10.1148/radiol.11091710. View

Parmar C, Grossmann P, Bussink J, Lambin P, Aerts H . Machine Learning methods for Quantitative Radiomic Biomarkers. Sci Rep. 2015; 5:13087. PMC: 4538374. DOI: 10.1038/srep13087. View

Huynh E, Coroller T, Narayan V, Agrawal V, Romano J, Franco I . Associations of Radiomic Data Extracted from Static and Respiratory-Gated CT Scans with Disease Recurrence in Lung Cancer Patients Treated with SBRT. PLoS One. 2017; 12(1):e0169172. PMC: 5207741. DOI: 10.1371/journal.pone.0169172. View

10.

Gulshan V, Peng L, Coram M, Stumpe M, Wu D, Narayanaswamy A . Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA. 2016; 316(22):2402-2410. DOI: 10.1001/jama.2016.17216. View

11.

Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P . The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013; 26(6):1045-57. PMC: 3824915. DOI: 10.1007/s10278-013-9622-7. View

12.

Jaffe C . Measures of response: RECIST, WHO, and new alternatives. J Clin Oncol. 2006; 24(20):3245-51. DOI: 10.1200/JCO.2006.06.5599. View

13.

Bryan S, Weatherburn G, Watkins J, Roddie M, Keen J, Muris N . Radiology report times: impact of picture archiving and communication systems. AJR Am J Roentgenol. 1998; 170(5):1153-9. DOI: 10.2214/ajr.170.5.9574575. View

14.

Folio L, Nelson C, Benjamin M, Ran A, Engelhard G, Bluemke D . Quantitative Radiology Reporting in Oncology: Survey of Oncologists and Radiologists. AJR Am J Roentgenol. 2015; 205(3):W233-43. PMC: 5697144. DOI: 10.2214/AJR.14.14054. View

15.

Johnson A, Chen M, Zapadka M, Lyders E, Littenberg B . Radiology report clarity: a cohort study of structured reporting compared with conventional dictation. J Am Coll Radiol. 2010; 7(7):501-6. DOI: 10.1016/j.jacr.2010.02.008. View

16.

Litjens G, Sanchez C, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I . Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016; 6:26286. PMC: 4876324. DOI: 10.1038/srep26286. View

17.

Shin Y, Balasingham I . Comparison of hand-craft feature based SVM and CNN based deep learning framework for automatic polyp classification. Annu Int Conf IEEE Eng Med Biol Soc. 2017; 2017:3277-3280. DOI: 10.1109/EMBC.2017.8037556. View

18.

Kooi T, Litjens G, van Ginneken B, Gubern-Merida A, Sanchez C, Mann R . Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal. 2016; 35:303-312. DOI: 10.1016/j.media.2016.07.007. View

19.

Kolossvary M, Kellermayer M, Merkely B, Maurovich-Horvat P . Cardiac Computed Tomography Radiomics: A Comprehensive Review on Radiomic Techniques. J Thorac Imaging. 2017; 33(1):26-34. DOI: 10.1097/RTI.0000000000000268. View

20.

LeCun Y, Bengio Y, Hinton G . Deep learning. Nature. 2015; 521(7553):436-44. DOI: 10.1038/nature14539. View