» Articles » PMID: 38891158

Artificial Intelligence in Postoperative Care: Assessing Large Language Models for Patient Recommendations in Plastic Surgery

Overview
Specialty Health Services
Date 2024 Jun 19
PMID 38891158
Authors
Affiliations
Soon will be listed here.
Abstract

Since their release, the medical community has been actively exploring large language models' (LLMs) capabilities, which show promise in providing accurate medical knowledge. One potential application is as a patient resource. This study analyzes and compares the ability of the currently available LLMs, ChatGPT-3.5, GPT-4, and Gemini, to provide postoperative care recommendations to plastic surgery patients. We presented each model with 32 questions addressing common patient concerns after surgical cosmetic procedures and evaluated the medical accuracy, readability, understandability, and actionability of the models' responses. The three LLMs provided equally accurate information, with GPT-3.5 averaging the highest on the Likert scale (LS) (4.18 ± 0.93) ( = 0.849), while Gemini provided significantly more readable ( = 0.001) and understandable responses ( = 0.014; = 0.001). There was no difference in the actionability of the models' responses ( = 0.830). Although LLMs have shown their potential as adjunctive tools in postoperative patient care, further refinement and research are imperative to enable their evolution into comprehensive standalone resources.

Citing Articles

Using Large Language Models to Retrieve Critical Data from Clinical Processes and Business Rules.

Yu Y, Gomez-Cabello C, Makarova S, Parte Y, Borna S, Haider S Bioengineering (Basel). 2025; 12(1).

PMID: 39851291 PMC: 11762383. DOI: 10.3390/bioengineering12010017.


Evaluation of the integration of retrieval-augmented generation in large language model for breast cancer nursing care responses.

Xu R, Hong Y, Zhang F, Xu H Sci Rep. 2024; 14(1):30794.

PMID: 39730573 PMC: 11680762. DOI: 10.1038/s41598-024-81052-3.

References
1.
Cox A, Seth I, Xie Y, Hunter-Smith D, Rozen W . Utilizing ChatGPT-4 for Providing Medical Information on Blepharoplasties to Patients. Aesthet Surg J. 2023; 43(8):NP658-NP662. DOI: 10.1093/asj/sjad096. View

2.
Leslie D, Mazumder A, Peppin A, Wolters M, Hagerty A . Does "AI" stand for augmenting inequality in the era of covid-19 healthcare?. BMJ. 2021; 372:n304. PMC: 7958301. DOI: 10.1136/bmj.n304. View

3.
Abi-Rafeh J, Henry N, Xu H, Bassiri-Tehrani B, Arezki A, Kazan R . Utility and Comparative Performance of Current Artificial Intelligence Large Language Models as Postoperative Medical Support Chatbots in Aesthetic Surgery. Aesthet Surg J. 2024; 44(8):889-896. DOI: 10.1093/asj/sjae025. View

4.
Ayers J, Poliak A, Dredze M, Leas E, Zhu Z, Kelley J . Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum. JAMA Intern Med. 2023; 183(6):589-596. PMC: 10148230. DOI: 10.1001/jamainternmed.2023.1838. View

5.
Vallurupalli M, Shah N, Vyas R . Validation of ChatGPT 3.5 as a Tool to Optimize Readability of Patient-facing Craniofacial Education Materials. Plast Reconstr Surg Glob Open. 2024; 12(2):e5575. PMC: 10836906. DOI: 10.1097/GOX.0000000000005575. View