The Assessment of the Validity, Safety, and Utility of ChatGPT for Patients with Herniated Lumbar Disc: A Preliminary Study

Overview

Journal Medicine (Baltimore)

Specialty General Medicine

Date 2024 Jun 7

PMID 38847711

Authors

Seoyon Yang

Min Cheol Chang

Affiliations

Soon will be listed here.

Abstract

ChatGPT is perceived as a potential tool for patients diagnosed with herniated lumbar disc (HLD) to ask questions concerning desired information, with provision for necessary responses. In this preliminary study, we assessed the validity, safety, and utility of ChatGPT in patients with HLD. Two physicians specializing in the treatment of musculoskeletal disorders discussed and determined the 12 most frequently asked questions by patients with HLD in clinical practice. We used ChatGPT (version 4.0) to ask questions related to HLD. Each question was inputted into ChatGPT, and the responses were assessed by the 2 physicians. A Likert score was used to evaluate the validity, safety, and utility of the responses generated by ChatGPT. Each score for validity, safety, and utility was divided into 4 points, with a score of 4 indicating the most valid, safe, and useful answers and 1 point indicating the worst answers. Regarding validity, ChatGPT responses demonstrated 4 points for 9 questions (9/12, 75.0%) and 3 points for 3 questions (3/12, 25.0%). Regarding safety, ChatGPT scored 4 points for 11 questions (11/12, 91.7%) and 3 points for 1 question (1/12, 8.3%). Regarding utility, ChatGPT responses exhibited 4 points for 9 questions (9/12, 75.0%) and 3 points for 3 questions (3/12, 25.0%). ChatGPT demonstrates a tendency to offer relatively valid, safe, and useful information regarding HLD. However, users should exercise caution as ChatGPT may occasionally provide incomplete answers to some questions on HLD.

Citing Articles

Assessing the Validity, Safety, and Utility of ChatGPT's Responses for Patients with Frozen Shoulder.

Yang S, Kim Y, Chang M, Jeon J, Hong K, Yi Y Life (Basel). 2025; 15(2).

PMID: 40003671 PMC: 11857066. DOI: 10.3390/life15020262.

Development of an automated foot contact area measurement program for podoscopes using ChatGPT-4: a case report.

Chang M J Yeungnam Med Sci. 2024; 42:13.

PMID: 39623860 PMC: 11812087. DOI: 10.12701/jyms.2024.01326.

Assessing the Accuracy of Artificial Intelligence Models in Scoliosis Classification and Suggested Therapeutic Approaches.

Fabijan A, Zawadzka-Fabijan A, Fabijan R, Zakrzewski K, Nowoslawska E, Polis B J Clin Med. 2024; 13(14).

PMID: 39064053 PMC: 11278075. DOI: 10.3390/jcm13144013.

References

Yin H, Zhang X, Huang Z, Song Y, Zhu Q . Efficacy of Single Level Versus Double Levels Surgery of Percutaneous Disc Nucleoplasty (PDN) Approach in Treating Lumbar Disc Herniation. Med Sci Monit. 2021; 27:e930000. PMC: 8330383. DOI: 10.12659/MSM.930000. View

Khoromi S, Patsalides A, Parada S, Salehi V, Meegan J, Max M . Topiramate in chronic lumbar radicular pain. J Pain. 2005; 6(12):829-36. DOI: 10.1016/j.jpain.2005.08.002. View

Kwak S, Jang S, Chang M . Long-term outcomes of transforaminal epidural steroid injection in patients with lumbosacral radicular pain according to the location, type, and size of herniated lumbar disc. Pain Pract. 2021; 21(8):836-842. DOI: 10.1111/papr.13029. View

Miao H, Ahn H . Impact of ChatGPT on Interdisciplinary Nursing Education and Research. Asian Pac Isl Nurs J. 2023; 7:e48136. PMC: 10167576. DOI: 10.2196/48136. View

Beack J, Chun H, Bak K, Choi K, Bae I, Kim K . Risk Factors of Secondary Lumbar Discectomy of a Herniated Lumbar Disc after Lumbar Discectomy. J Korean Neurosurg Soc. 2019; 62(5):586-593. PMC: 6732352. DOI: 10.3340/jkns.2019.0085. View

Taheri A, Khajenasiri A, Nazemian Yazdi N, Safari S, Sadeghi J, Hatami M . Clinical Evaluation of Percutaneous Caudal Epidural Adhesiolysis With the Racz Technique for Low Back Pain Due to Contained Disc Herniation. Anesth Pain Med. 2016; 6(3):e26749. PMC: 5097854. DOI: 10.5812/aapm.26749. View

Suk K, Lee H, Moon S, Kim N . Recurrent lumbar disc herniation: results of operative management. Spine (Phila Pa 1976). 2001; 26(6):672-6. DOI: 10.1097/00007632-200103150-00024. View

Oh J, Park K, Jung S, Young Chung S, Kim S, Park M . Surgical results and risk factors for recurrence of lumbar disc herniation. Korean J Spine. 2015; 9(3):170-5. PMC: 4430997. DOI: 10.14245/kjs.2012.9.3.170. View

Gaston P, Marshall R . Survival analysis is a better estimate of recurrent disc herniation. J Bone Joint Surg Br. 2003; 85(4):535-7. DOI: 10.1302/0301-620x.85b4.13813. View

10.

Yu P, Xu H, Hu X, Deng C . Leveraging Generative AI and Large Language Models: A Comprehensive Roadmap for Healthcare Integration. Healthcare (Basel). 2023; 11(20). PMC: 10606429. DOI: 10.3390/healthcare11202776. View

11.

Chang M, Park D . YouTube as a Source of Information on Epidural Steroid Injection. J Pain Res. 2021; 14:1353-1357. PMC: 8149278. DOI: 10.2147/JPR.S307506. View

12.

Xue V, Lei P, Cho W . The potential impact of ChatGPT in clinical and translational medicine. Clin Transl Med. 2023; 13(3):e1216. PMC: 9976604. DOI: 10.1002/ctm2.1216. View

13.

Clusmann J, Kolbinger F, Muti H, Carrero Z, Eckardt J, Laleh N . The future landscape of large language models in medicine. Commun Med (Lond). 2023; 3(1):141. PMC: 10564921. DOI: 10.1038/s43856-023-00370-1. View

14.

Shrestha N, Shen Z, Zaidat B, Duey A, Tang J, Ahmed W . Performance of ChatGPT on NASS Clinical Guidelines for the Diagnosis and Treatment of Low Back Pain: A Comparison Study. Spine (Phila Pa 1976). 2024; 49(9):640-651. DOI: 10.1097/BRS.0000000000004915. View

15.

Ramamurthi A, Are C, Kothari A . From ChatGPT to Treatment: the Future of AI and Large Language Models in Surgical Oncology. Indian J Surg Oncol. 2023; 14(3):537-539. PMC: 10611626. DOI: 10.1007/s13193-023-01836-3. View

16.

Uz C, Umay E . "Dr ChatGPT": Is it a reliable and useful source for common rheumatic diseases?. Int J Rheum Dis. 2023; 26(7):1343-1349. DOI: 10.1111/1756-185X.14749. View

17.

Shanthanna H, Chan P, McChesney J, Thabane L, Paul J . Pulsed radiofrequency treatment of the lumbar dorsal root ganglion in patients with chronic lumbar radicular pain: a randomized, placebo-controlled pilot study. J Pain Res. 2014; 7:47-55. PMC: 3894138. DOI: 10.2147/JPR.S55749. View

18.

Hatia A, Doldo T, Parrini S, Chisci E, Cipriani L, Montagna L . Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study. J Clin Med. 2024; 13(3). PMC: 10856539. DOI: 10.3390/jcm13030735. View

19.

Lee H, Chang M . YouTube as a source of information regarding the effect of vitamin C on coronavirus disease. Complement Ther Med. 2022; 67:102827. PMC: 8968205. DOI: 10.1016/j.ctim.2022.102827. View

20.

Botwin K, Gruber R, Bouchlas C, Freeman T, Slaten W . Complications of fluoroscopically guided transforaminal lumbar epidural injections. Arch Phys Med Rehabil. 2000; 81(8):1045-50. DOI: 10.1053/apmr.2000.7166. View