Poster Session I - A52 THE USE OF LARGE LANGUAGE MODELS IN GASTROENTEROLOGY LITERATURE: A GROWING ARTIFICIAL INTELLIGENCE FOOTPRINT

海报展示环节 I - A52 大型语言模型在胃肠病学文献中的应用:人工智能日益增长的影响力

阅读:1

Abstract

BACKGROUND: The integration of Large Language Models (LLMs) into academic writing has transformed scientific literature, but the adoption within the gastrointestinal (GI) literature remains to be quantified. AIMS: In this study, we aim to estimate the proportion of classical LLM-related language in GI abstracts from 2010 to 2024, and to characterize its variation across impact factor (IF) quartiles, and impact on lexical patterns. METHODS: We conducted a retrospective, bibliometric analysis of 158,473 PubMed-indexed GI abstracts, sourced from all GI-related journals with 2024 IF ≥ 2 as found on Clarivate. A synthetic corpus of 10,000 GPT-3.5 generated abstracts was used to model AI-like linguistic distributions. The annual proportion of AI-like text (α) was estimated using a maximum-likelihood mixture model with Laplace smoothing. Journals were stratified into quartiles by their 2024 IF for sub-analysis. Lexical diversity was quantified on a yearly basis, using the type-token ratio (TTR). RESULTS: Between 2010-2019, α was negligible (<0.001%), with only a discrete inflection beginning in 2016 (α = 0.07%). A sharp rise is noted after the introduction of ChatGPT, reaching successively 0.86% (2020), 1.77% (2021), 1.35% (2022), 1.95% (2023), and finally up to 4.68% (2024). By IF quartile, α demonstrated a U-shaped curve, lowest in Q2/Q3 (4.2% and 2.97% respectively), and highest in Q1/Q4 (5.4% and 5.7%), suggesting disproportionate adoption in both high and lower-impact journals. Lexical diversity remained stable throughout a measured period of 15 years (TTR range 0.0067 to 0.0089), demonstrating that the increased AI-related language was not associated to measurable shifts in vocabulary. CONCLUSIONS: The prevalence of LLM-related language in GI abstracts has increased sharply since the mass-introduction of LLMs, with a five-fold surge subsequent to the release of ChatGPT. These findings suggest a growing integration of LLMs in the GI body of knowledge, suggesting a need for clear editorial policies and standards of transparency regarding AI-assisted writing. FUNDING AGENCIES: None [Image: see text]

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。