Research Domain Criteria in NIMH Grants Characterized Using Large Language Models

利用大型语言模型表征NIMH资助项目中的研究领域标准

阅读:1

Abstract

IMPORTANCE: Over the past decade, the leadership of the National Institute of Mental Health (NIMH) has emphasized the importance of a transdiagnostic approach to psychiatric investigation using Research Domain Criteria (RDoC) mapping more closely to neurobiology. OBJECTIVE: To investigate whether research support from the NIMH for individual RDoC domains and for transdiagnostic investigation has changed over time and has had differential impact in terms of publication, citations, or patent filings. DESIGN, SETTING, AND PARTICIPANTS: In this longitudinal cohort study, all R01, R21, and R03 studies funded by the NIMH between January 2003 and December 2023 were identified via the National Institutes of Health RePORTER database. Their abstracts were characterized in terms of RDoC domains (negative valence, positive valence, cognition, social, arousal, and sensorimotor) using a large language model. MAIN OUTCOMES AND MEASURES: Primary outcomes were publications, citation impact estimated at 5 years from the index year of funding, and patents, examined using regression models adjusted for other grant characteristics. RESULTS: Among 8897 R01, R03, and R21 projects, reflecting $17.7 billion of investment, abstracts of 3141 (35.3%) reflected negative valence; 1344 (15.1%), positive valence; 2781 (31.3%), cognition; 1607 (18.1%), social; 343 (3.9%), arousal; and 571 (6.4%), sensorimotor domains. A total of 1793 (20.2%) incorporated a transdiagnostic perspective. Positive and social domains were associated with fewer publications (difference, -1.13 [95% CI, -2.11 to -0.15] and -2.23 [95% CI, -3.15 to -1.30], respectively) and lesser citation impact (difference, -0.47 [95% CI, -0.75 to -0.18] and -1.19 [95% CI, -1.46 to -0.91], respectively) at 5 years. Social (adjusted odds ratio [AOR], 0.11; 95% CI, 0.04-0.23) and cognitive (AOR, 0.66; 95% CI, 0.48-0.89) domains and transdiagnostic proposals (AOR, 0.37; 95% CI, 0.21-0.60) were associated with lower likelihood of patent filing. CONCLUSIONS AND RELEVANCE: In this study of NIMH funding, grants reflecting different RDoC domains differed substantially in their scientific impact in terms of publications, citations, and patent generation. The findings suggest that large language models represent a promising approach to characterizing research proposals at scale, which may be useful in guiding resource allocation to maximize scientific return on investment.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。