提出一种高效局部学习规则,让神经形态芯片可低功耗训练视觉模型。
TESS: A Scalable Temporally and Spatially Local Learning Rule for Spiking Neural Networks
- 基于局部信号实现时空信用分配,避免全局反向传播
- 在多个边缘视觉数据集上达到比BPTT低1.4%准确率
- 适合资源受限的终端设备实时学习场景
边缘设备对低功耗推理与训练深度神经网络的需求日益增长,推动了高效算法的发展。尽管脉冲神经网络(SNN)通过事件驱动方式能高效处理复杂时空动态,但传统基于误差反向传播(BP)的方法在资源受限设备上仍面临计算和内存开销大的挑战。本文受生物机制启发,提出TESS——一种时空局部的学习规则,仅依赖每个神经元本地信号完成时间与空间上的信用分配,使计算与内存开销随神经元数量线性增长,与时间步数无关。尽管完全基于局部机制,其性能在多个边缘计算相关视觉任务上接近反向传播时序(BPTT)算法,如IBM DVS手势数据集、CIFAR10-DVS、CIFAR10和CIFAR100的时序版本,差距约1.4个准确率点。TESS在保持低时间与内存复杂度的同时实现媲美BPTT的性能,使边缘设备上的高效可扩展在线学习成为可能。
原文摘要 · Abstract (English)
The demand for low-power inference and training of deep neural networks (DNNs) on edge devices has intensified the need for algorithms that are both scalable and energy-efficient. While spiking neural networks (SNNs) allow for efficient inference by processing complex spatio-temporal dynamics in an event-driven fashion, training them on resource-constrained devices remains challenging due to the high computational and memory demands of conventional error backpropagation (BP)-based approaches. In this work, we draw inspiration from biological mechanisms such as eligibility traces, spike-timing-dependent plasticity, and neural activity synchronization to introduce TESS, a temporally and spatially local learning rule for training SNNs. Our approach addresses both temporal and spatial credit assignments by relying solely on locally available signals within each neuron, thereby allowing computational and memory overheads to scale linearly with the number of neurons, independently of the number of time steps. Despite relying on local mechanisms, we demonstrate performance comparable to the backpropagation through time (BPTT) algorithm, within $\sim1.4$ accuracy points on challenging computer vision scenarios relevant at the edge, such as the IBM DVS Gesture dataset, CIFAR10-DVS, and temporal versions of CIFAR10, and CIFAR100. Being able to produce comparable performance to BPTT while keeping low time and memory complexity, TESS enables efficient and scalable on-device learning at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。