arXiv:2504.02591cs.LG2025-04被引 6

提出新型多输入多输出脉冲神经元,提升小规模网络性能。

State-Space Model Inspired Multiple-Input Multiple-Output Spiking Neurons

  • 将脉冲神经元建模为状态空间模型,支持多输入多输出
  • 增加输出通道数可显著提升小规模网络精度
  • 适合资源受限场景下高效脉冲神经网络设计

在脉冲神经网络(SNNs)中,神经元是信息处理的基本单元,其内部状态基于膜电位生成输出脉冲,并传递给网络中其他神经元。本文提出一种通用的多输入多输出(MIMO)脉冲神经元模型,突破了传统单输入单输出(SISO)范式。该模型基于状态空间模型(SSM),采用线性状态演化与非线性放电激活函数。我们分析了隐藏状态数量、输入输出通道数等参数的影响,涵盖单输入多输出(SIMO)和多输入单输出(MISO)情形。结果表明,在神经元数量少但内部状态空间大的情况下,增加神经元输出通道数可带来显著性能提升。尤其在相同参考架构下,使用多输出脉冲神经元的网络可达到与连续值通信基准相当的准确率。

原文摘要 · Abstract (English)

In spiking neural networks (SNNs), the main unit of information processing is the neuron with an internal state. The internal state generates an output spike based on its component associated with the membrane potential. This spike is then communicated to other neurons in the network. Here, we propose a general multiple-input multiple-output (MIMO) spiking neuron model that goes beyond this traditional single-input single-output (SISO) model in the SNN literature. Our proposed framework is based on interpreting the neurons as state-space models (SSMs) with linear state evolutions and non-linear spiking activation functions. We illustrate the trade-offs among various parameters of the proposed SSM-inspired neuron model, such as the number of hidden neuron states, the number of input and output channels, including single-input multiple-output (SIMO) and multiple-input single-output (MISO) models. We show that for SNNs with a small number of neurons with large internal state spaces, significant performance gains may be obtained by increasing the number of output channels of a neuron. In particular, a network with spiking neurons with multiple-output channels may achieve the same level of accuracy with the baseline with the continuous-valued communications on the same reference network architecture.

脉冲神经网络状态空间模型多输出神经元

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。