arXiv:2602.01978cs.NEcs.LG2026-02

无需代理梯度,实现高精度时间模式的在线训练与硬件映射。

SpikingGamma: Surrogate-Gradient Free and Temporally Precise Online Training of Spiking Neural Networks with Smoothed Delays

  • 采用内部递归记忆结构与sigma-delta编码,支持直接反向传播。
  • 可在极低脉冲频率下学习精细时间模式,且对时间分辨率不敏感。
  • 适合需要低延迟、低功耗的神经形态硬件部署场景。

神经形态硬件中的脉冲神经网络(SNN)通过稀疏的事件驱动计算,有望实现高效节能、低延迟的人工智能。然而,在精细时间离散化下的SNN训练仍是重大挑战,限制了其低延迟响应能力及软件训练模型向高效硬件的映射。现有方法将脉冲神经元建模为自循环单元,嵌入循环网络中维持状态,并基于代理梯度使用BPTT或RTRL变体进行训练。这些方法随时间分辨率提升而性能急剧下降,且在线近似常因长序列导致不稳定,难以精确捕捉时间模式。为此,我们提出具有内部递归记忆结构的脉冲神经元,并结合sigma-delta脉冲编码。实验表明,SpikingGamma模型支持无需代理梯度的直接误差反向传播,可在在线模式下以极少脉冲学习精细时间模式,且能扩展至复杂任务和基准测试,准确率具有竞争力,同时对模型的时间分辨率不敏感。该方法为当前依赖代理梯度的循环SNN提供了替代方案,并为SNN到神经形态硬件的直接映射开辟新路径。

原文摘要 · Abstract (English)

Neuromorphic hardware implementations of Spiking Neural Networks (SNNs) promise energy-efficient, low-latency AI through sparse, event-driven computation. Yet, training SNNs under fine temporal discretization remains a major challenge, hindering both low-latency responsiveness and the mapping of software-trained SNNs to efficient hardware. In current approaches, spiking neurons are modeled as self-recurrent units, embedded into recurrent networks to maintain state over time, and trained with BPTT or RTRL variants based on surrogate gradients. These methods scale poorly with temporal resolution, while online approximations often exhibit instability for long sequences and tend to fail at capturing temporal patterns precisely. To address these limitations, we develop spiking neurons with internal recursive memory structures that we combine with sigma-delta spike-coding. We show that this SpikingGamma model supports direct error backpropagation without surrogate gradients, can learn fine temporal patterns with minimal spiking in an online manner, and scale feedforward SNNs to complex tasks and benchmarks with competitive accuracy, all while being insensitive to the temporal resolution of the model. Our approach offers both an alternative to current recurrent SNNs trained with surrogate gradients, and a direct route for mapping SNNs to neuromorphic hardware.

脉冲神经网络神经形态计算在线训练时间精度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。