无需反向传播的可扩展脉冲神经网络,实现低功耗深度学习。
Scalable Learning in Structured Recurrent Spiking Neural Networks without Backpropagation

- 分层递归结构+稀疏长程连接,局部更新维持硬件可扩展性
- 采用群体竞争教学信号与调制神经元,实现无梯度监督学习
- 适合神经形态硬件部署,适用于生物启发式智能系统研究
脉冲神经网络(SNN)为节能且具生物合理性的计算提供了前景;然而,在深层递归架构中实现可扩展学习仍面临重大挑战。本文提出一种结构化的多层递归SNN架构,由局部密集的递归层和稀疏的小世界长程投影至读出种群组成。长程连接基本固定,保持路由效率与硬件可扩展性,而突触适应通过严格局部可塑性机制完成。为在无反向传播或替代梯度的情况下实现监督学习,我们引入一种生物启发的学习框架,包含:(i) 输出层的群体胜者为王(WTA)教学信号,(ii) 固定随机广播反馈路径,(iii) 低维调制神经元群体通过三因子学习规则与时间可塑性痕迹控制突触更新。该设计支持深层递归计算,具有稀疏全局通信和纯局部突触更新。我们分析了算法特性、计算复杂度与硬件可行性,并在基准分类任务上展示了稳定学习与具有竞争力的性能。结果表明,结构化递归与神经调制学习有望推动超越梯度方法的可扩展、硬件兼容的SNN训练。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) provide a promising framework for energy-efficient and biologically grounded computation; however, scalable learning in deep recurrent architectures with sparse connectivity remains a major challenge. In this work, we propose a structured multi-layer recurrent SNN architecture composed of locally dense recurrent layers augmented with sparse small-world long-range projections to a readout population. The long-range connectivity is largely fixed, preserving routing efficiency and hardware scalability, while synaptic adaptation is performed using strictly local plasticity mechanisms. To enable supervised learning without backpropagation or surrogate gradients, we introduce a biologically motivated learning framework that combines: (i) population-based winner-take-all (WTA) teaching signals at the output layer, (ii) fixed random broadcast alignment feedback pathways, and (iii) low-dimensional modulatory neuron populations that gate synaptic updates through three-factor learning rules with eligibility traces. This design supports deep recurrent computation with sparse global communication and purely local synaptic updates. We analyze the algorithmic properties, computational complexity, and hardware feasibility of the proposed approach, and demonstrate stable learning and competitive performance on benchmark classification tasks. The results highlight the potential of structured recurrence and neuromodulatory learning to enable scalable, hardware-compatible SNN training beyond gradient-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。