Effectiveness of Digital Interventions for Low-Income, Food-Insecure Populations: Natural Language Processing Study of WIC Smartphone App User Reviews, 2013-2024

数字干预措施对低收入、粮食不安全人群的有效性:基于WIC智能手机应用程序用户评论的自然语言处理研究(2013-2024年)

阅读:1

Abstract

BACKGROUND: The Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) is a federal nutrition assistance program for low-income, food-insecure mothers and young children in the United States. Despite its intended goals, many eligible individuals forgo WIC benefits, in part due to administrative burden-defined as the complex, often frustrating processes encountered when navigating public benefit programs. In response, a range of digital interventions and policy waivers were introduced during the COVID-19 pandemic, but their effectiveness in reducing barriers remains unclear. OBJECTIVE: Drawing from administrative burden theory and human-computer interaction research, this study examined user reviews of WIC smartphone apps (WIC Apps) used by local agencies. Specifically, it investigated (1) how obstacles to WIC access manifested in daily app use, (2) how user experiences shifted after the onset of the COVID-19 pandemic, and (3) how these changes were associated with app ratings. METHODS: An original dataset of user reviews (Nreview=28,212) was compiled for 26 WIC Apps between 2013 and 2024. Structural topic modeling identified 8 key themes, and sentiment was examined with Robustly Optimized Bidirectional Encoder Representations From Transformers Pretraining Approach. Analyses compared topic prevalence and sentiment distributions before and after COVID-19. Mixed-effects models examined the relationship between topics, sentiment, and app ratings. RESULTS: Technical concerns related to account authentication and login, document upload, and app updates were among the most prevalent themes. These issues were typically expressed with negative sentiment and appeared more frequently in pre-COVID-19 reviews than in post-COVID-19 reviews. Although reliability problems (eg, outages and maintenance) persisted, post-COVID-19 reviews increasingly emphasized features that facilitated program tracking, shopping and benefit redemption, and general ease of use, which were generally described with positive sentiment. Mixed-effects analyses indicated that these post-COVID-19 topics were significantly associated with higher app ratings (program tracking: B=0.21, SE=0.06; P=.001; shopping and redemption: B=0.18, SE=0.07; P=.01; and ease of use: B=0.10, SE=0.05; P=.04), whereas pre-COVID-19 concerns were not associated with ratings (Ps>.05). When sentiment was added to the mixed-effect model, it became the dominant factor: negative sentiment was associated with lower ratings (B=-1.71, SE=0.03; P<.001), and positive sentiment was associated with higher ratings (B=1.78, SE=0.03; P<.001). After accounting for sentiment, no individual topic was significantly associated with ratings (Ps>.05), suggesting that sentiment contributed to much of the variance previously linked to topics. CONCLUSIONS: User-centered digital interventions, such as WIC Apps, have the potential to support WIC access and participation.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。