提出一种可在硬件上实时训练的脉冲神经网络优化方法。
A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks
- 用反馈控制信号驱动脉冲网络权重更新,实现局部在线学习。
- 单层脉冲网络性能接近传统人工神经网络,支持持续在线学习。
- 适合边缘计算中对能效和实时性要求高的智能系统应用。
与传统人工神经网络不同,生物神经网络通过稀疏活动、递归连接和局部学习规则解决复杂认知任务,这些机制成为类脑计算的设计原则,有助于缓解现代计算的能耗问题。然而,大多数混合信号类脑设备依赖半监督或无监督学习规则,在有监督学习任务中效果不佳。缺乏可扩展的片上学习方案限制了混合信号设备在可持续智能边缘系统中的潜力。为此,我们提出一种新型脉冲神经网络(SNN)学习算法,将基于脉冲的权重更新与反馈控制信号结合。在该框架中,脉冲控制器生成反馈信号以引导SNN活动并驱动权重更新,实现可扩展且局部的片上学习。我们在多种分类任务上评估该算法,结果表明,使用反馈控制训练的单层SNN性能可媲美人工神经网络(ANN)。随后,我们在混合信号类脑设备上测试其连续在线学习表现,并评估对超参数失配的鲁棒性。结果表明,该反馈控制优化器适用于类脑应用场景,推动了边缘应用中可扩展片上学习解决方案的发展。
原文摘要 · Abstract (English)
Unlike traditional artificial neural networks (ANNs), biological neuronal networks solve complex cognitive tasks with sparse neuronal activity, recurrent connections, and local learning rules. These mechanisms serve as design principles in Neuromorphic computing, which addresses the critical challenge of energy consumption in modern computing. However, most mixed-signal neuromorphic devices rely on semi- or unsupervised learning rules, which are ineffective for optimizing hardware in supervised learning tasks. This lack of scalable solutions for on-chip learning restricts the potential of mixed-signal devices to enable sustainable, intelligent edge systems. To address these challenges, we present a novel learning algorithm for Spiking Neural Networks (SNNs) on mixed-signal devices that integrates spike-based weight updates with feedback control signals. In our framework, a spiking controller generates feedback signals to guide SNN activity and drive weight updates, enabling scalable and local on-chip learning. We first evaluate the algorithm on various classification tasks, demonstrating that single-layer SNNs trained with feedback control achieve performance comparable to artificial neural networks (ANNs). We then assess its implementation on mixed-signal neuromorphic devices by testing network performance in continuous online learning scenarios and evaluating resilience to hyperparameter mismatches. Our results show that the feedback control optimizer is compatible with neuromorphic applications, advancing the potential for scalable, on-chip learning solutions in edge applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。