arXiv:2502.20411cs.NEcs.AI2025-02被引 10

不用反向传播,用前向-前向算法训练脉冲神经网络

Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm

  • 采用双前向传递机制,实现局部化、高效训练
  • 在多个数据集上达到顶尖脉冲网络性能,模型更轻量
  • 适合追求低功耗、生物可解释性训练的硬件部署场景

脉冲神经网络(SNN)通过离散脉冲信号模拟神经元活动,具有生物合理性与低功耗优势。然而传统反向传播(BP)训练存在计算效率低且不具生物合理性的问题。本文探索前向-前向(FF)算法作为SNN的替代训练框架。与依赖前后向传递的BP不同,FF算法仅需两次前向传播,支持逐层局部学习,提升计算效率并增强与类脑硬件的兼容性。我们提出一种基于FF的SNN训练框架,在非脉冲数据集(MNIST、Fashion-MNIST、Kuzushiji-MNIST)和脉冲数据集(Neuro-MNIST、SHD)上进行评估。实验表明,该模型在静态数据集上性能优于现有FF-SNN,且模型更轻量;在复杂脉冲任务(如SHD)中,表现超越多数SNN模型,并保持与先进BP-SNN相当的精度。结果证明,FF算法有望克服BP的关键局限,推动SNN训练方法的发展。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm's potential to advance SNN training methodologies by addressing some key limitations of backpropagation.

脉冲神经网络前向-前向类脑计算无反向传播

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。