arXiv:2502.12791cs.CVcs.LG2025-02AAAI

提出一种单步传播机制,让脉冲神经网络更快更准地处理感知任务。

Activation-wise Propagation: A One-Timestep Strategy for Spiking Neural Networks

  • 通过神经元间电位动态传播,实现单时间步更新隐藏状态。
  • 在点云与事件数据上显著提升多层感知机和卷积网络的精度与效率。
  • 通用性强,适用于MLP、CNN及基于Transformer的SNN,适合低延迟场景。

脉冲神经网络(SNNs)因其事件驱动和参数高效特性,在实时多传感器感知任务中展现出巨大潜力。其核心挑战在于神经元隐藏状态(膜电位)的时间步迭代更新,导致准确率与延迟之间难以平衡。现有方法通常依赖更长的时间步以获得更好性能,但会带来更高的计算开销与延迟。此外,许多近期进展依赖于特定架构优化,虽在少时间步下有效,却限制了跨模态与模型的通用性与可扩展性。为此,我们提出激活层面膜电位传播(AMP2),一种统一的SNN隐藏状态更新机制。受生物神经元膜电位空间传播启发,AMP2实现相邻神经元间膜电位的动态传递,促进时空融合与隐藏状态协同演化,从而在减少对长时间更新依赖的同时提升效率与准确率。该策略在点云与事件数据上的MLP与CNN中均显著增强性能。进一步的消融实验表明,将AMP2集成至基于Transformer的SNN分类任务中,验证其作为通用、高效SNN解决方案的潜力。

原文摘要 · Abstract (English)

Spiking neural networks (SNNs) have demonstrated significant potential in real-time multi-sensor perception tasks due to their event-driven and parameter-efficient characteristics. A key challenge is the timestep-wise iterative update of neuronal hidden states (membrane potentials), which complicates the trade-off between accuracy and latency. SNNs tend to achieve better performance with longer timesteps, inevitably resulting in higher computational overhead and latency compared to artificial neural networks (ANNs). Moreover, many recent advances in SNNs rely on architecture-specific optimizations, which, while effective with fewer timesteps, often limit generalizability and scalability across modalities and models. To address these limitations, we propose Activation-wise Membrane Potential Propagation (AMP2), a unified hidden state update mechanism for SNNs. Inspired by the spatial propagation of membrane potentials in biological neurons, AMP2 enables dynamic transmission of membrane potentials among spatially adjacent neurons, facilitating spatiotemporal integration and cooperative dynamics of hidden states, thereby improving efficiency and accuracy while reducing reliance on extended temporal updates. This simple yet effective strategy significantly enhances SNN performance across various architectures, including MLPs and CNNs for point cloud and event-based data. Furthermore, ablation studies integrating AMP2 into Transformer-based SNNs for classification tasks demonstrate its potential as a general-purpose and efficient solution for spiking neural networks.

脉冲神经网络低延迟动态传播

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。