Validating Digital Scribes: A Scoping Review of Evaluation Practices and Clinical Use

验证数字速记员:评估实践和临床应用范围综述

阅读:1

Abstract

Clinical documentation accounts for a substantial share of clinicians’ working time, contributing to administrative burden and reduced patient-facing care. Artificial intelligence has stimulated the development of digital scribes that combine speech recognition (ASR) and large language models (LLMs) to generate clinical notes from patient–provider conversations with the aim to automate and support this process and reduce this burden. This scoping review explores how digital scribes are currently validated, both technical and clinical, and whether they reliably support clinical workflows. Using the Technology Readiness Level (TRL) framework, we show that most systems remain in early development stages (typically TRL 3&4), with only a small number progressing to workflow integration. While digital scribes show potential to improve documentation efficiency, validation methods are highly heterogeneous, most studies rely on simulated or retrospective data, and real-world testing is limited. Consequently, cross-system comparisons and conclusions about clinical performance remain limited. We identified three motivational frames: human-, performance-, and system-oriented, which shape evaluation practices and outcome expectations. These findings suggest that successful implementation depends not only on scribes’ technical capability but also on alignment with clinical needs and documentation styles. Overall, our review underscores the need for standardised validation frameworks and prospective real-world studies to ensure that digital scribes progress beyond their current low TRL and move from experimental promise to safe, effective, and sustainable integration into clinical care. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10916-026-02392-3.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。