arXiv:2509.24411cs.NEcs.AI2025-09被引 6

提出可端到端训练的分层混合神经网络,兼顾效率与精度。

Hybrid Layer-Wise ANN-SNN With Surrogate Spike Encoding-Decoding Structure

  • 在ANN中嵌入分层脉冲编码解码块,用代理梯度实现可微训练。
  • 在MNIST等数据集上达到与纯ANN相当的准确率(99.3%)。
  • 适合追求低功耗、高效率的神经网络部署场景。

脉冲神经网络(SNN)因其在能效计算方面的潜力,在计算神经科学和人工智能领域备受关注。相比之下,人工神经网络(ANN)在基于梯度的优化和高精度方面表现优异。这一对比催生了混合ANN-SNN研究的兴起。然而,现有方法通常依赖于ANN与SNN组件的严格分离,或采用仅含SNN编码器、后续接ANN分类器的结构,受限于脉冲编码函数的不可微性,导致反向传播过程中缺乏深层协作。为此,本文提出一种新型混合框架,将分层编码-解码的SNN模块集成于传统ANN流程中。核心在于使用代理梯度对基于位平面的脉冲编码函数进行近似,从而实现跨ANN与SNN层的端到端可微训练。该设计在保持脉冲计算的时间表征与能效优势的同时,达到了与先进纯ANN及SNN模型相当的性能。据我们所知,这是首个针对位平面编码与通用脉冲编码接口应用代理梯度的实现,成功开辟了一类新型混合模型,为未来研究指明新方向。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) have gained significant traction in both computational neuroscience and artificial intelligence for their potential in energy-efficient computing. In contrast, artificial neural networks (ANNs) excel at gradient-based optimization and high accuracy. This contrast has consequently led to a growing subfield of hybrid ANN-SNN research. However, existing hybrid approaches often rely on either a strict separation between ANN and SNN components or employ SNN-only encoders followed by ANN classifiers due to the constraints of non-differentiability of spike encoding functions, causing prior hybrid architectures to lack deep layer-wise cooperation during backpropagation. To address this gap, we propose a novel hybrid ANN-SNN framework that integrates layer-wise encode-decode SNN blocks within conventional ANN pipelines. Central to our method is the use of surrogate gradients for a bit-plane-based spike encoding function, enabling end-to-end differentiable training across ANN and SNN layers. This design achieves competitive accuracy with state-of-the-art pure ANN and SNN models while retaining the potential efficiency and temporal representation benefits of spiking computation. To the best of our knowledge, this is the first implementation of a surrogate gradient for bit plane coding specifically and spike encoder interface in general to be utilized in the context of hybrid ANN-SNN, successfully leading to a new class of hybrid models that pave new directions for future research.

混合神经网络脉冲神经网络代理梯度能效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。