Explainability in AI-enabled medical neurotechnology: a scoping review

人工智能赋能的医学神经技术的可解释性:范围界定综述

阅读:2

Abstract

Artificial Intelligence (AI) approaches, including Machine Learning (ML), and other complex algorithms, are driving progress in medical closed-loop neurotechnology, including neurostimulation systems and brain–computer interfaces (BCIs). These advances are transforming the treatment landscape for neurological and psychiatric conditions. However, the inherent opacity of many AI models raises clinical, epistemological and ethical challenges. Explainability is widely recognized as a critical requirement for addressing these challenges, yet its concrete application in neurotechnology remains insufficiently explored. Objective. This scoping review maps how Explainable AI (XAI) methods are implemented in AI-enabled closed-loop neurotechnologies and examines how explainability is conceptualized and operationalized in this domain. Approach. Following JBI guidance and PRISMA-ScR, we systematically searched five databases for original research on AI-enabled medical closed-loop neurotechnologies targeting neurological and psychiatric conditions. A total of 161 studies were included and analyzed using descriptive statistics and qualitative content analysis to identify the presence and framing of XAI methods. Main results. Explainable AI adoption in medical neurotechnology is limited: only 14 studies (9%) employed explicit XAI techniques. Thematic analysis of the full corpus identified three recurring barriers and focal points: (A) technical constraints and proposed workarounds, (B) challenges in explanation quality and system transparency, and (C) the relationship between explainability and user trust. Significance. Although closed-loop neurotechnologies are rapidly advancing, explainability is rarely implemented in practice, constraining transparency, accountability, and clinical usability. Our findings reveal key factors behind the explainability gap and provides a framework to guide future research and development. Addressing this shortfall is essential for fostering ethically sound, clinically effective, and patient-trusted neurotechnological applications.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。