Accuracy of Machine Learning in the Diagnosis of Odontogenic Cysts and Tumors: a Systematic Review and Meta-analysis

Overview

Journal Oral Radiol

Specialty Radiology

Date 2024 Mar 26

PMID 38530559

Authors

Priyanshu Kumar Shrivastava

Shamimul Hasan

Laraib Abid

Ranjit Injety

Ayush Kumar Shrivastav

Deborah Sybil

Affiliations

Soon will be listed here.

Abstract

Background: The recent impact of artificial intelligence in diagnostic services has been enormous. Machine learning tools offer an innovative alternative to diagnose cysts and tumors radiographically that pose certain challenges due to the near similar presentation, anatomical variations, and superimposition. It is crucial that the performance of these models is evaluated for their clinical applicability in diagnosing cysts and tumors.

Methods: A comprehensive literature search was carried out on eminent databases for published studies between January 2015 and December 2022. Studies utilizing machine learning models in the diagnosis of odontogenic cysts or tumors using Orthopantomograms (OPG) or Cone Beam Computed Tomographic images (CBCT) were included. QUADAS-2 tool was used for the assessment of the risk of bias and applicability concerns. Meta-analysis was performed for studies reporting sufficient performance metrics, separately for OPG and CBCT.

Results: 16 studies were included for qualitative synthesis including a total of 10,872 odontogenic cysts and tumors. The sensitivity and specificity of machine learning in diagnosing cysts and tumors through OPG were 0.83 (95% CI 0.81-0.85) and 0.82 (95% CI 0.81-0.83) respectively. Studies utilizing CBCT noted a sensitivity of 0.88 (95% CI 0.87-0.88) and specificity of 0.88 (95% CI 0.87-0.89). Highest classification accuracy was 100%, noted for Support Vector Machine classifier.

Conclusion: The results from the present review favoured machine learning models to be used as a clinical adjunct in the radiographic diagnosis of odontogenic cysts and tumors, provided they undergo robust training with a huge dataset. However, the arduous process, investment, and certain ethical concerns associated with the total dependence on technology must be taken into account. Standardized reporting of outcomes for diagnostic studies utilizing machine learning methods is recommended to ensure homogeneity in assessment criteria, facilitate comparison between different studies, and promote transparency in research findings.

References

Corbella S, Srinivas S, Cabitza F . Applications of deep learning in dentistry. Oral Surg Oral Med Oral Pathol Oral Radiol. 2020; 132(2):225-238. DOI: 10.1016/j.oooo.2020.11.003. View

Rajkomar A, Dean J, Kohane I . Machine Learning in Medicine. N Engl J Med. 2019; 380(14):1347-1358. DOI: 10.1056/NEJMra1814259. View

Endres M, Hillen F, Salloumis M, Sedaghat A, Niehues S, Quatela O . Development of a Deep Learning Algorithm for Periapical Disease Detection in Dental Radiographs. Diagnostics (Basel). 2020; 10(6). PMC: 7344682. DOI: 10.3390/diagnostics10060430. View

Lee J, Kim D, Jeong S, Choi S . Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent. 2018; 77:106-111. DOI: 10.1016/j.jdent.2018.07.015. View

Krois J, Ekert T, Meinhold L, Golla T, Kharbot B, Wittemeier A . Deep Learning for the Radiographic Detection of Periodontal Bone Loss. Sci Rep. 2019; 9(1):8495. PMC: 6560098. DOI: 10.1038/s41598-019-44839-3. View

McInnes M, Moher D, Thombs B, McGrath T, Bossuyt P, Clifford T . Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA. 2018; 319(4):388-396. DOI: 10.1001/jama.2017.19163. View

Ariji Y, Yanashita Y, Kutsuna S, Muramatsu C, Fukuda M, Kise Y . Automatic detection and classification of radiolucent lesions in the mandible on panoramic radiographs using a deep learning object detection technique. Oral Surg Oral Med Oral Pathol Oral Radiol. 2019; 128(4):424-430. DOI: 10.1016/j.oooo.2019.05.014. View

Lee J, Kim D, Jeong S . Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network. Oral Dis. 2019; 26(1):152-158. DOI: 10.1111/odi.13223. View

Lee A, Kim M, Han S, Park P, Lee C, Yun J . Deep learning neural networks to differentiate Stafne's bone cavity from pathological radiolucent lesions of the mandible in heterogeneous panoramic radiography. PLoS One. 2021; 16(7):e0254997. PMC: 8291753. DOI: 10.1371/journal.pone.0254997. View

10.

Liu Z, Liu J, Zhou Z, Zhang Q, Wu H, Zhai G . Differential diagnosis of ameloblastoma and odontogenic keratocyst by machine learning of panoramic radiographs. Int J Comput Assist Radiol Surg. 2021; 16(3):415-422. PMC: 7946691. DOI: 10.1007/s11548-021-02309-0. View

11.

Poedjiastoeti W, Suebnukarn S . Application of Convolutional Neural Network in the Diagnosis of Jaw Tumors. Healthc Inform Res. 2018; 24(3):236-241. PMC: 6085208. DOI: 10.4258/hir.2018.24.3.236. View

12.

Yang H, Jo E, Kim H, Cha I, Jung Y, Nam W . Deep Learning for Automated Detection of Cyst and Tumors of the Jaw in Panoramic Radiographs. J Clin Med. 2020; 9(6). PMC: 7356620. DOI: 10.3390/jcm9061839. View

13.

Yu D, Hu J, Feng Z, Song M, Zhu H . Deep learning based diagnosis for cysts and tumors of jaw with massive healthy samples. Sci Rep. 2022; 12(1):1855. PMC: 8814152. DOI: 10.1038/s41598-022-05913-5. View

14.

Currie G, Hawk K, Rohren E, Vial A, Klein R . Machine Learning and Deep Learning in Medical Imaging: Intelligent Imaging. J Med Imaging Radiat Sci. 2019; 50(4):477-487. DOI: 10.1016/j.jmir.2019.09.005. View

15.

Jammal A, Thompson A, Mariottoni E, Berchuck S, Urata C, Estrela T . Human Versus Machine: Comparing a Deep Learning Algorithm to Human Gradings for Detecting Glaucoma on Fundus Photographs. Am J Ophthalmol. 2019; 211:123-131. PMC: 7073295. DOI: 10.1016/j.ajo.2019.11.006. View

16.

Thrall J, Li X, Li Q, Cruz C, Do S, Dreyer K . Artificial Intelligence and Machine Learning in Radiology: Opportunities, Challenges, Pitfalls, and Criteria for Success. J Am Coll Radiol. 2018; 15(3 Pt B):504-508. DOI: 10.1016/j.jacr.2017.12.026. View

17.

Sounderajah V, Ashrafian H, Rose S, Shah N, Ghassemi M, Golub R . A quality assessment tool for artificial intelligence-centered diagnostic test accuracy studies: QUADAS-AI. Nat Med. 2021; 27(10):1663-1665. DOI: 10.1038/s41591-021-01517-0. View