arXiv:2508.11674cs.NEcs.AI2025-08

优化神经元内在参数提升脉冲网络性能,兼具高精度与低功耗。

Learning Internal Biological Neuron Parameters and Complexity-Based Encoding for Improved Spiking Neural Networks Performance

  • 用生物真实神经元模型替代传统抽象,联合学习突触权重与内在参数。
  • 相比仅调网络规模和学习率的基线,准确率最高提升13.50个百分点。
  • 结合莱姆普尔-兹瓦复杂度,实现毫秒级响应且可解释的时空编码分类。

本研究提出一种新型脉冲神经网络(SNN)学习范式,摒弃感知机启发的抽象,改用基于生物学的神经元模型,联合优化突触权重与内在神经元参数。评估了漏电积分-放电(LIF)与元神经元两种架构,在固定与可学习内在动态条件下表现。此外,引入一种生物启发的分类框架,结合SNN动力学与莱姆普尔-兹瓦复杂度(LZC),实现对时空脉冲数据的高效可解释分类。训练采用代理梯度反向传播、脉冲时间依赖可塑性(STDP)及Tempotron规则,基于泊松过程生成的脉冲序列——该模型在计算神经科学中被广泛采纳为标准随机神经元放电模型,因其解析可处理性与经验相关性。优化内在参数使LIF网络分类准确率最高提升13.50个百分点,元神经元模型提升8.50个百分点。所提出的SNN-LZC分类器达到最高99.50%准确率,推理延迟低于毫秒级,能耗表现具有竞争力。理论方面,形式化证明优化内在动态可扩大假设空间,并在标准光滑性假设下为内在参数更新提供下降保证,将内在优化与代理目标的可证明改进相联系。

原文摘要 · Abstract (English)

This study proposes a novel learning paradigm for spiking neural networks (SNNs) that replaces the perceptron-inspired abstraction with biologically grounded neuron models, jointly optimizing synaptic weights and intrinsic neuronal parameters. We evaluate two architectures, leaky integrate-and-fire (LIF) and a meta-neuron model, under fixed and learnable intrinsic dynamics. Additionally, we introduce a biologically inspired classification framework that combines SNN dynamics with Lempel-Ziv complexity (LZC), enabling efficient and interpretable classification of spatiotemporal spike data. Training is conducted using surrogate-gradient backpropagation, spike-timing-dependent plasticity (STDP), and the Tempotron rule on spike trains generated from Poisson processes, widely adopted in computational neuroscience as a standard stochastic model of neuronal spike generation due to their analytical tractability and empirical relevance. Learning intrinsic parameters improves classification accuracy by up to 13.50 percentage points for LIF networks and 8.50 for meta-neuron models compared to baselines tuning only network size and learning rate. The proposed SNN-LZC classifier achieves up to 99.50% accuracy with sub-millisecond inference latency and competitive energy consumption. We further provide theoretical justification by formalizing how optimizing intrinsic dynamics enlarges the hypothesis class and proving descent guarantees for intrinsic-parameter updates under standard smoothness assumptions, linking intrinsic optimization to provable improvements in the surrogate objective.

脉冲神经网络生物神经元建模复杂度编码低功耗计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。