Biologically grounded neocortex computational primitives implemented on neuromorphic hardware improve vision transformer performance

基于生物学原理的新皮层计算原语在神经形态硬件上的实现可提升视觉转换器的性能

阅读:1

Abstract

Understanding the computational principles of the brain and translating them into neuromorphic hardware and modern deep learning architectures is critical for advancing neuro-inspired AI (NeuroAI). Here, we develop an experimentally constrained, biophysically realistic model of neocortical microcircuits in the mouse primary visual cortex (layers 2 to 3) to examine how four major interneuron classes-Parvalbumin, Somatostatin, vasoactive intestinal peptide, and LAMP5-interact within a competitive-cooperative motif to implement soft winner-take-all (sWTA) circuit dynamics. In a conductance-based network grounded in in vitro physiology, we show that this circuit motif selectively amplifies strong inputs while suppressing, without silencing, weaker ones, enabling gain modulation, signal restoration, and context-dependent multistability. Using a gain-matching strategy, we mapped the motif onto IBM's TrueNorth neuromorphic chip, revealing a principled correspondence between cell-type-specific roles and hardware primitives. Sparse coupling of sWTA modules generated persistent up-states and a two-state neural machine approximating working memory. We then embedded the sWTA circuit as a preprocessing filter in a Vision Transformer, which significantly enhanced out-of-distribution generalization across diverse tasks, including zero-shot digit classification, cross-domain transfer between digit datasets, and nighttime semantic segmentation. The sWTA filter boosted accuracy on unseen data by up to ~20% and reduced training compute by directing learning toward salient features, without additional data or architectural changes. By unifying biophysically grounded circuit models, neuromorphic implementation, and state-of-the-art AI architectures, this work outlines a generalizable roadmap for embedding cortical computation into next-generation NeuroAI systems that combine biological principles with practical AI performance gains.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。