Artificial Intelligence in Digital Pathology: a Systematic Review and Meta-analysis of Diagnostic Test Accuracy

Overview

Journal NPJ Digit Med

Specialty Medical Informatics

Date 2024 May 4

PMID 38704465

Authors

Clare McGenity

Emily L Clarke

Charlotte Jennings

Gillian Matthews

Caroline Cartlidge

Henschel Freduah-Agyemang

Deborah D Stocken

Darren Treanor

Affiliations

Soon will be listed here.

Abstract

Ensuring diagnostic performance of artificial intelligence (AI) before introduction into clinical practice is essential. Growing numbers of studies using AI for digital pathology have been reported over recent years. The aim of this work is to examine the diagnostic accuracy of AI in digital pathology images for any disease. This systematic review and meta-analysis included diagnostic accuracy studies using any type of AI applied to whole slide images (WSIs) for any disease. The reference standard was diagnosis by histopathological assessment and/or immunohistochemistry. Searches were conducted in PubMed, EMBASE and CENTRAL in June 2022. Risk of bias and concerns of applicability were assessed using the QUADAS-2 tool. Data extraction was conducted by two investigators and meta-analysis was performed using a bivariate random effects model, with additional subgroup analyses also performed. Of 2976 identified studies, 100 were included in the review and 48 in the meta-analysis. Studies were from a range of countries, including over 152,000 whole slide images (WSIs), representing many diseases. These studies reported a mean sensitivity of 96.3% (CI 94.1-97.7) and mean specificity of 93.3% (CI 90.5-95.4). There was heterogeneity in study design and 99% of studies identified for inclusion had at least one area at high or unclear risk of bias or applicability concerns. Details on selection of cases, division of model development and validation data and raw performance data were frequently ambiguous or missing. AI is reported as having high diagnostic accuracy in the reported areas but requires more rigorous evaluation of its performance.

Citing Articles

Systematic review and meta-analysis of artificial intelligence in classifying HER2 status in breast cancer immunohistochemistry.

Albuquerque D, Vianna M, Sampaio L, Vasiliu A, Neves Filho E NPJ Digit Med. 2025; 8(1):144.

PMID: 40050686 PMC: 11885561. DOI: 10.1038/s41746-025-01483-8.

Bridging imaging-based in vitro methods from biomedical research to regulatory toxicology.

Piergiovanni M, Mennecozzi M, Barale-Thomas E, Danovi D, Dunst S, Egan D Arch Toxicol. 2025; .

PMID: 39945818 DOI: 10.1007/s00204-024-03922-z.

Vision Transformers for Low-Quality Histopathological Images: A Case Study on Squamous Cell Carcinoma Margin Classification.

Park S, Ayana G, Wako B, Jeong K, Yoon S, Choe S Diagnostics (Basel). 2025; 15(3).

PMID: 39941191 PMC: 11817517. DOI: 10.3390/diagnostics15030260.

Evaluating the pathological and clinical implications of errors made by an artificial intelligence colon biopsy screening tool.

Evans H, Sivakumar N, Bhanderi S, Graham S, Snead D, Patel A BMJ Open Gastroenterol. 2025; 12(1.

PMID: 39762071 PMC: 11749196. DOI: 10.1136/bmjgast-2024-001649.

A Narrative Review of Molecular, Immunohistochemical and In-Situ Techniques in Dermatopathology.

Gabriel J, Weerasinghe N, Balachandran P, Salih R, Orchard G Br J Biomed Sci. 2025; 81:13437.

PMID: 39741925 PMC: 11687224. DOI: 10.3389/bjbs.2024.13437.

References

Whiting P, Rutjes A, Westwood M, Mallett S, Deeks J, Reitsma J . QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011; 155(8):529-36. DOI: 10.7326/0003-4819-155-8-201110180-00009. View

Jin Y, Jia S, Ashraf A, Hu P . Integrative Data Augmentation with U-Net Segmentation Masks Improves Detection of Lymph Node Metastases in Breast Cancer Patients. Cancers (Basel). 2020; 12(10). PMC: 7601653. DOI: 10.3390/cancers12102934. View

Miyoshi H, Sato K, Kabeya Y, Yonezawa S, Nakano H, Takeuchi Y . Deep learning shows the capability of high-level computer-aided diagnosis in malignant lymphoma. Lab Invest. 2020; 100(10):1300-1310. DOI: 10.1038/s41374-020-0442-3. View

Hameed Z, Zahia S, Garcia-Zapirain B, Aguirre J, Maria Vanegas A . Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models. Sensors (Basel). 2020; 20(16). PMC: 7472736. DOI: 10.3390/s20164373. View

Wei J, Suriawinata A, Vaickus L, Ren B, Liu X, Lisovsky M . Evaluation of a Deep Neural Network for Automated Classification of Colorectal Polyps on Histopathologic Slides. JAMA Netw Open. 2020; 3(4):e203398. PMC: 7180424. DOI: 10.1001/jamanetworkopen.2020.3398. View

Coudray N, Ocampo P, Sakellaropoulos T, Narula N, Snuderl M, Fenyo D . Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018; 24(10):1559-1567. PMC: 9847512. DOI: 10.1038/s41591-018-0177-5. View

Kanavati F, Ichihara S, Tsuneki M . A deep learning model for breast ductal carcinoma in situ classification in whole slide images. Virchows Arch. 2022; 480(5):1009-1022. DOI: 10.1007/s00428-021-03241-z. View

Zou J, Huss M, Abid A, Mohammadi P, Torkamani A, Telenti A . A primer on deep learning in genomics. Nat Genet. 2018; 51(1):12-18. PMC: 11180539. DOI: 10.1038/s41588-018-0295-5. View

Tizhoosh H, Pantanowitz L . Artificial Intelligence and Digital Pathology: Challenges and Opportunities. J Pathol Inform. 2019; 9:38. PMC: 6289004. DOI: 10.4103/jpi.jpi_53_18. View

10.

Tabibu S, Vinod P, Jawahar C . Pan-Renal Cell Carcinoma classification and survival prediction from histopathology images using deep learning. Sci Rep. 2019; 9(1):10509. PMC: 6642160. DOI: 10.1038/s41598-019-46718-3. View

11.

DiPalma J, Suriawinata A, Tafe L, Torresani L, Hassanpour S . Resolution-based distillation for efficient histology image classification. Artif Intell Med. 2021; 119:102136. PMC: 8449014. DOI: 10.1016/j.artmed.2021.102136. View

12.

Noorbakhsh J, Farahmand S, Foroughi Pour A, Namburi S, Caruana D, Rimm D . Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images. Nat Commun. 2020; 11(1):6367. PMC: 7733499. DOI: 10.1038/s41467-020-20030-5. View

13.

Ailia M, Thakur N, Abdul-Ghafar J, Jung C, Yim K, Chong Y . Current Trend of Artificial Intelligence Patents in Digital Pathology: A Systematic Evaluation of the Patent Landscape. Cancers (Basel). 2022; 14(10). PMC: 9139645. DOI: 10.3390/cancers14102400. View

14.

Sali R, Moradinasab N, Guleria S, Ehsan L, Fernandes P, Shah T . Deep Learning for Whole-Slide Tissue Histopathology Classification: A Comparative Study in the Identification of Dysplastic and Non-Dysplastic Barrett's Esophagus. J Pers Med. 2020; 10(4). PMC: 7711456. DOI: 10.3390/jpm10040141. View

15.

Sabol P, Sincak P, Hartono P, Kocan P, Benetinova Z, Blicharova A . Explainable classifier for improving the accountability in decision-making for colorectal cancer diagnosis from histopathological images. J Biomed Inform. 2020; 109:103523. DOI: 10.1016/j.jbi.2020.103523. View

16.

Patel A, Cooper N, Freeman S, Sutton A . Graphical enhancements to summary receiver operating characteristic plots to facilitate the analysis and reporting of meta-analysis of diagnostic test accuracy data. Res Synth Methods. 2020; 12(1):34-44. DOI: 10.1002/jrsm.1439. View

17.

Steinbuss G, Kriegsmann K, Kriegsmann M . Identification of Gastritis Subtypes by Convolutional Neuronal Networks on Histological Images of Antrum and Corpus Biopsies. Int J Mol Sci. 2020; 21(18). PMC: 7555568. DOI: 10.3390/ijms21186652. View

18.

Wu W, Li B, Mercan E, Mehta S, Bartlett J, Weaver D . MLCD: A Unified Software Package for Cancer Diagnosis. JCO Clin Cancer Inform. 2020; 4:290-298. PMC: 7113135. DOI: 10.1200/CCI.19.00129. View

19.

Choudhary T, Mishra V, Goswami A, Sarangapani J . A transfer learning with structured filter pruning approach for improved breast cancer classification on point-of-care devices. Comput Biol Med. 2021; 134:104432. DOI: 10.1016/j.compbiomed.2021.104432. View

20.

Wang C, Shi J, Zhang Q, Ying S . Histopathological image classification with bilinear convolutional neural networks. Annu Int Conf IEEE Eng Med Biol Soc. 2017; 2017:4050-4053. DOI: 10.1109/EMBC.2017.8037745. View