Abstract
BACKGROUND: Large language models (LLMs), such as ChatGPT have revolutionised patient education by offering accessible, reasonable, and empathetic guidance. This study evaluates ChatGPT's role in supporting patient inquiries regarding four key plastic surgery procedures: mastopexy, breast augmentation, breast reduction, and breast reconstruction. The study highlights its potential as a supplemental tool in patient education by assessing its performance across relevance, accuracy, clarity, and empathy criteria. METHODS: The study collected frequently asked questions from patients about the selected procedures during pre- and post-operative consultations. Responses were generated by ChatGPT and evaluated by a panel of Plastic Surgery experts. Scores from 1 to 5 were assigned to four criteria: relevance, accuracy, clarity, and empathy. Statistical analyses, including means, standard deviations, and Kruskal-Wallis tests, were conducted to evaluate differences in the scores assigned to responses across criteria and procedures. RESULTS: ChatGPT demonstrated high performance across all evaluation criteria, with clarity emerging as the strongest attribute, reflecting the model's ability to simplify complex medical concepts effectively. Accuracy, while slightly lower, remained reliable, aligning well with medical standards. Among the procedures, breast reconstruction appeared to perform particularly well, followed closely by mastopexy and breast augmentation. The analysis revealed no significant differences across the criteria, indicating consistent performance. CONCLUSIONS: ChatGPT demonstrated remarkable capability in addressing patient concerns and offering clear, empathetic, and relevant responses. However, limitations include the lack of personalised advice and potential patient misinterpretations, emphasising the need for professional oversight. ChatGPT is a valuable adjunct to professional medical consultations, enhancing patient education and engagement. Future research should focus on improving personalisation and evaluating its real-world application in clinical settings.