Adaptive state-feedback echo state networks for temporal sequence learning

用于时间序列学习的自适应状态反馈回声状态网络

阅读:1

Abstract

Echo State Networks are recurrent neural networks that leverage a random reservoir’s dynamics, training only a simple readout layer. This approach is computationally efficient but limits network performance. By introducing state or output-feedback connections, the reservoir dynamics can be shaped to enhance the network’s ability to capture complex temporal dependencies. Here we propose AFRICO (Adaptive Feedback, Readout and Input with Connectivity Optimisation), a novel training framework for Echo State Networks that adapts input and state-feedback weights via an Extended Kalman Filter, followed by optimisation of a sparse readout layer that selectively connects reservoir states to the output. The key novelty lies in jointly adapting input and state-feedback pathways to shape reservoir dynamics, while separately constructing a sparse task-specific readout. This approach enables the Echo State Network to capture both the internal dynamics and output mapping of the target system. We evaluate AFRICO on synthetic linear and nonlinear systems, as well as in vivo electrophysiological recordings from fly photoreceptors, demonstrating its versatility for general-purpose input–output time-series modelling across both engineering and biological domains. Across varied hyperparameter initialisations, AFRICO achieves up to 88% reduction in Normalised Mean Squared Error compared to Echo State Networks with fixed output-feedback, while maintaining modest computational effort relative to fully trained Recurrent Neural Networks. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1038/s41598-026-42971-5.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。