Impact of Human and Artificial Intelligence Collaboration on Workload Reduction in Medical Image Interpretation

Overview

Journal NPJ Digit Med

Specialty Medical Informatics

Date 2024 Nov 30

PMID 39616244

Authors

Mingyang Chen

Yuting Wang

Qiankun Wang

Jingyi Shi

Huike Wang

Zichen Ye

Peng Xue

Youlin Qiao

Affiliations

Soon will be listed here.

Abstract

Clinicians face increasing workloads in medical imaging interpretation, and artificial intelligence (AI) offers potential relief. This meta-analysis evaluates the impact of human-AI collaboration on image interpretation workload. Four databases were searched for studies comparing reading time or quantity for image-based disease detection before and after AI integration. The Quality Assessment of Studies of Diagnostic Accuracy was modified to assess risk of bias. Workload reduction and relative diagnostic performance were pooled using random-effects model. Thirty-six studies were included. AI concurrent assistance reduced reading time by 27.20% (95% confidence interval, 18.22%-36.18%). The reading quantity decreased by 44.47% (40.68%-48.26%) and 61.72% (47.92%-75.52%) when AI served as the second reader and pre-screening, respectively. Overall relative sensitivity and specificity are 1.12 (1.09, 1.14) and 1.00 (1.00, 1.01), respectively. Despite these promising results, caution is warranted due to significant heterogeneity and uneven study quality.

Citing Articles

Modern Management of Common Bile Duct Stones: Breakthroughs, Challenges, and Future Perspectives.

Sha Y, Wang Z, Tang R, Wang K, Xu C, Chen G Cureus. 2025; 16(12):e75246.

PMID: 39776736 PMC: 11703643. DOI: 10.7759/cureus.75246.

References

Rodriguez-Ruiz A, Lang K, Gubern-Merida A, Teuwen J, Broeders M, Gennaro G . Can we reduce the workload of mammographic screening by automatic identification of normal exams with artificial intelligence? A feasibility study. Eur Radiol. 2019; 29(9):4825-4832. PMC: 6682851. DOI: 10.1007/s00330-019-06186-9. View

Watanabe Y, Tanaka T, Nishida A, Takahashi H, Fujiwara M, Fujiwara T . Improvement of the diagnostic accuracy for intracranial haemorrhage using deep learning-based computer-assisted detection. Neuroradiology. 2020; 63(5):713-720. DOI: 10.1007/s00234-020-02566-x. View

Lin M, Zhou Q, Lei T, Shang N, Zheng Q, He X . Deep learning system improved detection efficacy of fetal intracranial malformations in a randomized controlled trial. NPJ Digit Med. 2023; 6(1):191. PMC: 10575919. DOI: 10.1038/s41746-023-00932-6. View

Yao B, Feng Y, Zhao K, Liang Y, Huang P, Zang J . Artificial intelligence assisted cytological detection for early esophageal squamous epithelial lesions by using low-grade squamous intraepithelial lesion as diagnostic threshold. Cancer Med. 2022; 12(2):1228-1236. PMC: 9883535. DOI: 10.1002/cam4.4984. View

Pei Y, Wang G, Cao H, Jiang S, Wang D, Wang H . A deep-learning pipeline to diagnose pediatric intussusception and assess severity during ultrasound scanning: a multicenter retrospective-prospective study. NPJ Digit Med. 2023; 6(1):182. PMC: 10541898. DOI: 10.1038/s41746-023-00930-8. View

Hempel H, Engbersen M, Wakkie J, van Kelckhoven B, de Monye W . Higher agreement between readers with deep learning CAD software for reporting pulmonary nodules on CT. Eur J Radiol Open. 2022; 9:100435. PMC: 9356194. DOI: 10.1016/j.ejro.2022.100435. View

Dang L, Chazard E, Poncelet E, Serb T, Rusu A, Pauwels X . Impact of artificial intelligence in breast cancer screening with mammography. Breast Cancer. 2022; 29(6):967-977. PMC: 9587927. DOI: 10.1007/s12282-022-01375-9. View

Sung J, Park S, Lee S, Bae W, Park B, Jung E . Added Value of Deep Learning-based Detection System for Multiple Major Findings on Chest Radiographs: A Randomized Crossover Study. Radiology. 2021; 299(2):450-459. DOI: 10.1148/radiol.2021202818. View

Marinovich M, Wylie E, Lotter W, Lund H, Waddell A, Madeley C . Artificial intelligence (AI) for breast cancer screening: BreastScreen population-based cohort study of cancer detection. EBioMedicine. 2023; 90:104498. PMC: 9996220. DOI: 10.1016/j.ebiom.2023.104498. View

10.

Jongsma K, Sand M, Milota M . Why we should not mistake accuracy of medical AI for efficiency. NPJ Digit Med. 2024; 7(1):57. PMC: 10912629. DOI: 10.1038/s41746-024-01047-2. View

11.

Conant E, Toledano A, Periaswamy S, Fotin S, Go J, Boatsman J . Improving Accuracy and Efficiency with Concurrent Use of Artificial Intelligence for Digital Breast Tomosynthesis. Radiol Artif Intell. 2020; 1(4):e180096. PMC: 6677281. DOI: 10.1148/ryai.2019180096. View

12.

Park J, Hwang Y, Nam J, Oh D, Kim K, Song H . Artificial intelligence that determines the clinical significance of capsule endoscopy images can increase the efficiency of reading. PLoS One. 2020; 15(10):e0241474. PMC: 7595411. DOI: 10.1371/journal.pone.0241474. View

13.

Tan H, Xu H, Yu N, Yu Y, Duan H, Fan Q . The value of deep learning-based computer aided diagnostic system in improving diagnostic performance of rib fractures in acute blunt trauma. BMC Med Imaging. 2023; 23(1):55. PMC: 10099632. DOI: 10.1186/s12880-023-01012-7. View

14.

Florian Andre , Fortner P, Aurich M, Seitz S, Jatsch A, Schobinger M . Human AI Teaming for Coronary CT Angiography Assessment: Impact on Imaging Workflow and Diagnostic Accuracy. Diagnostics (Basel). 2023; 13(23). PMC: 10706001. DOI: 10.3390/diagnostics13233574. View

15.

Bai X, Wei J, Starr D, Zhang X, Wu X, Guo Y . Assessment of Efficacy and Accuracy of Cervical Cytology Screening With Artificial Intelligence Assistive System. Mod Pathol. 2024; 37(6):100486. DOI: 10.1016/j.modpat.2024.100486. View

16.

Zhang B, Jia C, Wu R, Lv B, Li B, Li F . Improving rib fracture detection accuracy and reading efficiency with deep learning-based detection software: a clinical evaluation. Br J Radiol. 2020; 94(1118):20200870. PMC: 7934317. DOI: 10.1259/bjr.20200870. View

17.

Yala A, Schuster T, Miles R, Barzilay R, Lehman C . A Deep Learning Model to Triage Screening Mammograms: A Simulation Study. Radiology. 2019; 293(1):38-46. DOI: 10.1148/radiol.2019182908. View

18.

Park J, Hwang E, Lee J, Hong W, Nam J, Lim W . Identification of Active Pulmonary Tuberculosis Among Patients With Positive Interferon-Gamma Release Assay Results: Value of a Deep Learning-based Computer-aided Detection System in Different Scenarios of Implementation. J Thorac Imaging. 2023; 38(3):145-153. DOI: 10.1097/RTI.0000000000000691. View

19.

Hsu H, Ko K, Chou Y, Wu Y, Chiu S, Chang C . Performance and reading time of lung nodule identification on multidetector CT with or without an artificial intelligence-powered computer-aided detection system. Clin Radiol. 2021; 76(8):626.e23-626.e32. DOI: 10.1016/j.crad.2021.04.006. View

20.

Fu T, Viswanathan V, Attia A, Zerbib-Attal E, Kosaraju V, Barger R . Assessing the Potential of a Deep Learning Tool to Improve Fracture Detection by Radiologists and Emergency Physicians on Extremity Radiographs. Acad Radiol. 2023; 31(5):1989-1999. DOI: 10.1016/j.acra.2023.10.042. View