arXiv:2510.12843cs.LG2025-10

提出局部时标门机制,让神经元同时处理快慢信息,提升脉冲网络持续学习能力。

Local Timescale Gates for Timescale-Robust Continual Spiking Neural Networks

  • 每个神经元并行跟踪快慢两种时间尺度,通过自适应门控调节影响。
  • 在时序分类任务上达51%准确率,优于46%的基线方法。
  • 无需外部重放或正交化,适合英特尔Loihi芯片原生部署。

脉冲神经网络(SNNs)有望在类脑硬件上实现节能人工智能,但在需要快速适应与长期记忆的任务中表现不佳,尤其在持续学习场景下。本文提出局部时标门(LT-Gate)神经元模型,结合双时间常数动态与自适应门控机制。每个神经元并行追踪快慢两种时间尺度的信息,由一个可学习的门控局部调节其影响。该设计使单个神经元既能保留缓慢上下文信息,又能响应快速信号,缓解了稳定性-可塑性困境。我们进一步引入方差追踪正则化,模拟生物稳态以稳定放电活动。实验表明,LT-Gate在序列学习任务中显著提升准确率与记忆保持:在一项具有挑战性的时序分类基准上,最终准确率达约51%,高于近期基于赫布学习的持续学习基线(约46%)及以往SNN方法。与需外部重放或昂贵正交化的方案不同,LT-Gate仅依赖局部更新,完全兼容类脑硬件。尤其可利用英特尔Loihi芯片(支持多条具有不同衰减速率的突触痕迹)实现片上学习。结果表明,多时标门控能显著增强SNN的持续学习性能,缩小其与传统深度网络在终身学习任务上的差距。

原文摘要 · Abstract (English)

Spiking neural networks (SNNs) promise energy-efficient artificial intelligence on neuromorphic hardware but struggle with tasks requiring both fast adaptation and long-term memory, especially in continual learning. We propose Local Timescale Gating (LT-Gate), a neuron model that combines dual time-constant dynamics with an adaptive gating mechanism. Each spiking neuron tracks information on a fast and a slow timescale in parallel, and a learned gate locally adjusts their influence. This design enables individual neurons to preserve slow contextual information while responding to fast signals, addressing the stability-plasticity dilemma. We further introduce a variance-tracking regularization that stabilizes firing activity, inspired by biological homeostasis. Empirically, LT-Gate yields significantly improved accuracy and retention in sequential learning tasks: on a challenging temporal classification benchmark it achieves about 51 percent final accuracy, compared to about 46 percent for a recent Hebbian continual-learning baseline and lower for prior SNN methods. Unlike approaches that require external replay or expensive orthogonalizations, LT-Gate operates with local updates and is fully compatible with neuromorphic hardware. In particular, it leverages features of Intel's Loihi chip (multiple synaptic traces with different decay rates) for on-chip learning. Our results demonstrate that multi-timescale gating can substantially enhance continual learning in SNNs, narrowing the gap between spiking and conventional deep networks on lifelong-learning tasks.

脉冲神经网络持续学习类脑计算时标门控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。