不用反向传播,用前向-前向算法训练脉冲神经网络
Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
- 采用双前向传递机制,实现局部化、高效训练
- 在多个数据集上达到顶尖脉冲网络性能,模型更轻量
- 适合追求低功耗、生物可解释性训练的硬件部署场景
脉冲神经网络(SNN)通过离散脉冲信号模拟神经元活动,具有生物合理性与低功耗优势。然而传统反向传播(BP)训练存在计算效率低且不具生物合理性的问题。本文探索前向-前向(FF)算法作为SNN的替代训练框架。与依赖前后向传递的BP不同,FF算法仅需两次前向传播,支持逐层局部学习,提升计算效率并增强与类脑硬件的兼容性。我们提出一种基于FF的SNN训练框架,在非脉冲数据集(MNIST、Fashion-MNIST、Kuzushiji-MNIST)和脉冲数据集(Neuro-MNIST、SHD)上进行评估。实验表明,该模型在静态数据集上性能优于现有FF-SNN,且模型更轻量;在复杂脉冲任务(如SHD)中,表现超越多数SNN模型,并保持与先进BP-SNN相当的精度。结果证明,FF算法有望克服BP的关键局限,推动SNN训练方法的发展。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm's potential to advance SNN training methodologies by addressing some key limitations of backpropagation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。