Evaluation of the quality, reliability, and readability of ChatGPT-4 responses related to the treatment and rehabilitation of children with cerebral palsy

评估与脑瘫儿童治疗和康复相关的 ChatGPT-4 回答的质量、可靠性和可读性

阅读:1

Abstract

This study aims to evaluate the reliability, quality, and readability of ChatGPT-4's responses to questions about cerebral palsy (CP) and rehabilitation strategies. The 56 most frequently asked questions by families about CP, its treatment, and rehabilitation strategies were divided into five categories (A1-5) and asked in ChatGPT-4. The reliability, quality, and readability of the responses were assessed by two researchers, respectively, using the modified DISCERN (mDISCERN) tool, the Global Quality Scale (GQS), and the Flesch Reading Ease Scale (FRE). Median (IQR) values for mDISCERN ranged from 3 (3-3) in A5 to 4 (3-4) in A1, while GQS values ranged from 3 (3-3.5) in A2 to 3.5 (3-4) in A1. The mean readability values assessed with FRE ranged from 31.47 ± 12.92 to 44.84 ± 17.39. No statistically significant differences were observed between the categories. The ICC values suggested very good agreement for both scales, with 0.851 for the mDISCERN total score and 0.824 for the GQS total score. CONCLUSION: This study suggests that ChatGPT-4 provides moderate reliability and generally acceptable quality of responses regarding CP treatment and rehabilitation. FRE scores indicated that many responses were difficult for families to understand. While ChatGPT-4 may serve as a supportive source of general information, its outputs should be interpreted with caution, particularly in clinical contexts, and supervision and oversight by healthcare professionals remain essential for safe and effective use. WHAT'S KNOWN: • Children with cerebral palsy (CP) receive lifelong rehabilitation. Exercise plays a fundamental role in maintaining functional independence and quality of life, as well as physical development. The use of AI-based tools such as ChatGPT-4 for health information is increasingly widespread; however, uncertainties regarding the reliability, quality,and readability of these tools remain. WHAT IS NEW: • Our study shows that ChatGPT-4''s responses to questions about treatment and rehabilitation strategies for children with CP have moderate to good reliability and quality, but low readability.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。