arXiv:2508.06292cs.LG2025-08被引 2

提出新型脉冲神经元模型,实现低比特高效时序建模。

Low-Bit Data Processing Using Multiple-Output Spiking Neurons with Non-linear Reset Feedback

  • 设计多输出脉冲神经元,引入非线性重置反馈机制。
  • 在关键词识别等任务上达到现有脉冲网络基准性能。
  • 重置机制可稳定不稳定的线性动态,适合低功耗部署。

类脑计算是一种新兴技术,可实现低延迟与低功耗信号处理。脉冲神经网络(SNNs)是其中的关键算法工具,通过状态化神经元以脉冲编码信息,支持低比特数据处理。类似地,深度状态空间模型(SSMs)也使用状态化模块,但近期高性能的深层SSMs通常采用高精度激活函数且无重置机制。为结合SNN与深层SSM的优势,我们提出一种新型多输出脉冲神经元模型,融合线性通用SSM状态转移与通过重置实现的非线性反馈机制。相比现有SNN神经元模型,本模型清晰区分了脉冲函数、重置条件与重置动作。在关键词识别、事件视觉与序列模式识别等任务上的实验表明,该模型性能与现有脉冲网络基准相当。结果表明,所提重置机制可克服不稳定性,即使线性部分动态不稳定仍能学习,突破了当前深层SSM对严格线性稳定性要求的限制。

原文摘要 · Abstract (English)

Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks which utilize stateful neurons, and provide low-bit data processing by encoding and decoding information using spikes. Similar to SNNs, deep state-space models (SSMs) utilize stateful building blocks. However, deep SSMs, which recently achieved competitive performance in various temporal modeling tasks, are typically designed with high-precision activation functions and no reset mechanisms. To bridge the gains offered by SNNs and the recent deep SSM models, we propose a novel multiple-output spiking neuron model that combines a linear, general SSM state transition with a non-linear feedback mechanism through reset. Compared to the existing neuron models for SNNs, our proposed model clearly conceptualizes the differences between the spiking function, the reset condition and the reset action. The experimental results on various tasks, i.e., a keyword spotting task, an event-based vision task and a sequential pattern recognition task, show that our proposed model achieves performance comparable to existing benchmarks in the SNN literature. Our results illustrate how the proposed reset mechanism can overcome instability and enable learning even when the linear part of neuron dynamics is unstable, allowing us to go beyond the strictly enforced stability of linear dynamics in recent deep SSM models.

脉冲神经网络类脑计算时序建模低比特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。