Investigation of Artificial Intelligence-based Clinical Decision Support System's Performance in Reducing the Fine Needle Aspiration Rate of Thyroid Nodules: A Pilot Study

Overview

Journal Ultrasound

Date 2024 Dec 10

PMID 39654847

Authors

Amy Barnes

Rebecca White

Heather Venables

Vincent Lam

Ram Vaidhyanath

Affiliations

Soon will be listed here.

Abstract

Introduction: This pilot study aims to evaluate the clinical impact of artificial intelligence-based decision support, Koios Decision Support™, on the diagnostic performance of ultrasound assessment of thyroid nodules, and as a result to avoid fine needle aspiration.

Methods: This retrospective pilot study was conducted on ultrasound images of thyroid nodules investigated with fine needle aspiration from January 2022 to December 2022. Orthogonal ultrasound images of thyroid nodules, previously investigated with fine needle aspiration, were compared with the Koios Decision Support™ suggestion to perform fine needle aspiration. Surgical histology was used as ground truth.

Results: A total of 29 patients (76% women) with a mean age of 48 ± 16.5 years were evaluated, = 15 (52%) were histologically proven benign and = 14 (48%) were malignant. In the benign group, Koios Decision Support™ suggested avoidable fine needle aspiration in = 8 (53%). In the malignant group, Koios Decision Support™ suggested follow-up or no fine needle aspiration in = 2 (14%). Sensitivity is 85.7% ( = 12) ( = 0.027), whereas specificity is 53.3% ( = 8) ( = 0.027). The positive predictive value is 63.2% ( = 12), negative predictive value is 80% ( = 8), false-negative value is 20% ( = 2) and false-positive value is 36.8% ( = 7). Based on artificial intelligence decision, one cancer would have been missed.

Conclusion: Artificial intelligence can improve specificity without significantly compromising sensitivity. There was a suggested reduction in the fine needle aspiration rate, in the histologically proven benign nodules, by 53%. This had no statistical significance, likely due to the small population, however, it is thought to be the largest study to date. Further investigation with wider-ranging studies is suggested.

References

Yamashita R, Kapoor T, Alam M, Galimzianova A, Syed S, Ugur Akdogan M . Toward Reduction in False-Positive Thyroid Nodule Biopsies with a Deep Learning-based Risk Stratification System Using US Cine-Clip Images. Radiol Artif Intell. 2022; 4(3):e210174. PMC: 9152684. DOI: 10.1148/ryai.210174. View

Watkins L, ONeill G, Young D, McArthur C . Comparison of British Thyroid Association, American College of Radiology TIRADS and Artificial Intelligence TIRADS with histological correlation: diagnostic performance for predicting thyroid malignancy and unnecessary fine needle aspiration rate. Br J Radiol. 2021; 94(1123):20201444. PMC: 8248201. DOI: 10.1259/bjr.20201444. View

Kim D, Kim S, Basurrah M, Lee J, Hwang S . Diagnostic Performance of Six Ultrasound Risk Stratification Systems for Thyroid Nodules: A Systematic Review and Network Meta-Analysis. AJR Am J Roentgenol. 2023; 220(6):791-803. DOI: 10.2214/AJR.22.28556. View

Pitt S, Zanocco K, Sturgeon C . The Patient Experience of Thyroid Cancer. Endocrinol Metab Clin North Am. 2022; 51(4):761-780. DOI: 10.1016/j.ecl.2022.04.002. View

Hoang J, Middleton W, Farjat A, Teefey S, Abinanti N, Boschini F . Interobserver Variability of Sonographic Features Used in the American College of Radiology Thyroid Imaging Reporting and Data System. AJR Am J Roentgenol. 2018; 211(1):162-167. DOI: 10.2214/AJR.17.19192. View

Wildman-Tobriner B, Buda M, Hoang J, Middleton W, Thayer D, Short R . Using Artificial Intelligence to Revise ACR TI-RADS Risk Stratification of Thyroid Nodules: Diagnostic Accuracy and Utility. Radiology. 2019; 292(1):112-119. DOI: 10.1148/radiol.2019182128. View

Swan K, Thomas J, Nielsen V, Jespersen M, Bonnema S . External validation of AIBx, an artificial intelligence model for risk stratification, in thyroid nodules. Eur Thyroid J. 2022; 11(2). PMC: 8963165. DOI: 10.1530/ETJ-21-0129. View

Perros P, Boelaert K, Colley S, Evans C, Evans R, Gerrard Ba G . Guidelines for the management of thyroid cancer. Clin Endocrinol (Oxf). 2014; 81 Suppl 1:1-122. DOI: 10.1111/cen.12515. View

Liu Y, Su L, Xiao H . Review of Factors Related to the Thyroid Cancer Epidemic. Int J Endocrinol. 2017; 2017:5308635. PMC: 5438865. DOI: 10.1155/2017/5308635. View

10.

Poller D, Bongiovanni M, Trimboli P . Risk of malignancy in the various categories of the UK Royal College of Pathologists Thy terminology for thyroid FNA cytology: A systematic review and meta-analysis. Cancer Cytopathol. 2019; 128(1):36-42. DOI: 10.1002/cncy.22201. View

11.

Fernandez Velasco P, Perez Lopez P, Torres Torres B, Delgado E, de Luis D, Diaz Soto G . Clinical Evaluation of an Artificial Intelligence-Based Decision Support System for the Diagnosis and American College of Radiology Thyroid Imaging Reporting and Data System Classification of Thyroid Nodules. Thyroid. 2024; 34(4):510-518. DOI: 10.1089/thy.2023.0603. View

12.

Hoang J, Langer J, Middleton W, Wu C, Hammers L, Cronan J . Managing incidental thyroid nodules detected on imaging: white paper of the ACR Incidental Thyroid Findings Committee. J Am Coll Radiol. 2014; 12(2):143-50. DOI: 10.1016/j.jacr.2014.09.038. View

13.

Ahn S, Kim E, Kang D, Lim S, Kwak J, Kim M . Biopsy of thyroid nodules: comparison of three sets of guidelines. AJR Am J Roentgenol. 2009; 194(1):31-7. DOI: 10.2214/AJR.09.2822. View

14.

Tessler F, Middleton W, Grant E, Hoang J . Re: ACR Thyroid Imaging, Reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. J Am Coll Radiol. 2018; 15(3 Pt A):381-382. DOI: 10.1016/j.jacr.2017.12.035. View

15.

Al-Chalabi H, Karthik S, Vaidyanathan S . Radiological-pathological correlation of the British Thyroid Association ultrasound classification of thyroid nodules: a real-world validation study. Clin Radiol. 2019; 74(9):702-711. DOI: 10.1016/j.crad.2019.05.026. View

16.

Buda M, Wildman-Tobriner B, Hoang J, Thayer D, Tessler F, Middleton W . Management of Thyroid Nodules Seen on US Images: Deep Learning May Match Performance of Radiologists. Radiology. 2019; 292(3):695-701. PMC: 10257128. DOI: 10.1148/radiol.2019181343. View