Temporal single spike coding for effective transfer learning in spiking neural networks

脉冲神经网络中用于有效迁移学习的时间单脉冲编码

阅读:1

Abstract

In this work, a supervised learning rule based on Temporal Single Spike Coding for Effective Transfer Learning (TS4TL) is presented, an efficient approach for training multilayer fully connected Spiking Neural Networks (SNNs) as classifier blocks within a Transfer Learning (TL) framework. A new target assignment method named as "Absolute Target" is proposed, which utilizes a fixed, non-relative target signal specifically designed for single-spike temporal coding. In this approach, the firing time of the correct output neuron is treated as the target spike time, while no spikes are assigned to the other neurons. Unlike existing relative target strategies, this method minimizes computational complexity, reduces training time, and decreases energy consumption by limiting the number of spikes required for classification, all while ensuring a stable and computationally efficient training process. By seamlessly integrating this learning rule into the TL framework, TS4TL effectively leverages pre-trained feature extractors, demonstrating robust performance even with limited labelled data and varying data distributions. The proposed learning rule scales efficiently across both shallow and deep network architectures while maintaining consistent accuracy and reliability. Extensive evaluations on benchmark datasets highlight the strength of this approach, achieving state-of-the-art accuracies, including 98.91% on Eth80, surpassing previous works, and 91.89% on Fashion-MNIST, outperforming all fully connected structures in the literature. Additionally, high accuracies of 98.45% and 97.75% were recorded on the MNIST and Caltech101-Face/Bike datasets, respectively. Furthermore, TS4TL addresses a critical challenge by effectively reducing neuron misfires, ensuring that neurons respond correctly based on first-spike coding, a significant improvement over manually imposed solutions seen in prior works. These contributions collectively highlight the potential of TS4TL as a scalable and high-performance solution for temporal learning in SNNs.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。