提出多时间尺度导纳脉冲神经网络,实现高稀疏性与梯度可训练的复杂放电模式。
Multi-Timescale Conductance Spiking Networks: A Sparse, Gradient-Trainable Framework with Rich Firing Dynamics for Enhanced Temporal Processing
- 通过调节快/慢/超慢导纳控制神经元动态,实现丰富放电行为。
- 在Mackey-Glass时间序列预测中优于LIF和AdLIF,且放电稀疏性显著提升。
- 无需代理梯度,支持端到端训练,适合类脑硬件部署。
脉冲神经网络(SNNs)有望为时序任务提供低功耗事件驱动计算,但现有神经元模型常在梯度可训练性、动态丰富性和高稀疏性之间权衡。尤其在回归任务中,近似误差、噪声和尖峰离散化会严重损害连续输出。许多最先进的SNN依赖简单经验动力学并使用代理梯度训练,对放电多样性与稀疏性控制有限。为此,我们提出多时间尺度导纳脉冲网络,通过调节快、慢和超慢导纳塑造电流-电压(I-V)曲线,使神经动力学自然涌现。该参数化方式可系统调控兴奋性,适合模拟电路高效实现,并在单个模型中呈现持续、瞬时和爆发等丰富放电模式。我们推导了其可微分的离散时间形式,支持直接通过时间反向传播,无需代理梯度。在预测极限下的Mackey-Glass时间序列回归任务中,评估前馈网络并与基础LIF及最先进AdLIF网络对比,结果表明本模型性能更优,同时通信与计算层面的活动稀疏性显著增强。这些结果表明,多时间尺度导纳脉冲神经元是能效感知时序处理与类脑实现的有力候选。
原文摘要 · Abstract (English)
Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off gradient-based trainability, dynamical richness, and high activity sparsity. These limitations are acute in regression, where approximation error, noise and spike discretization can severely degrade continuous-valued outputs. Indeed, many state-of-the-art (SOTA) SNNs rely on simple phenomenological dynamics trained with surrogate gradients and offer limited control over spiking diversity and sparsity. To overcome such limitations, we introduce multi-timescale conductance spiking networks, a gradient-trainable framework in which neural dynamics emerge from shaping the current-voltage (I-V) curve by tuning fast, slow and ultra-slow conductances. This parametrization allows systematic control over excitability, can be implemented efficiently in analog circuits, and yields rich firing regimes including tonic, phasic and bursting responses within a single model. We derive a discrete-time formulation of these differentiable dynamics, enabling direct backpropagation through time without surrogate-gradient approximations. To probe both trainability and accuracy, we evaluate feedforward networks of these neurons at the predictability limit of Mackey-Glass time-series regression and compare them to baseline LIF and SOTA AdLIF networks. Our model outperforms LIF and AdLIF networks, while exhibiting substantially sparser activity from both communication and computational perspectives. These results highlight multi-timescale conductance spiking neurons as a promising building block for energy-aware temporal processing and neuromorphic implementation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。