arXiv:2602.12236cs.NEcs.AI2026-02

为神经形态视觉系统设计节能脉冲预算机制,解决持续学习中的遗忘问题。

Energy-Aware Spike Budgeting for Continual Learning in Spiking Neural Networks for Neuromorphic Vision

  • 根据数据模态动态调整脉冲数量,结合经验回放与可学习神经元参数。
  • 在帧基数据上降低47%脉冲率,事件基数据上提升17.45%准确率。
  • 适合低功耗部署场景,尤其适用于持续学习的神经形态视觉系统。

基于脉冲神经网络(SNNs)的神经形态视觉系统可为事件相机和帧相机提供超低功耗感知,但灾难性遗忘仍是其在持续演变环境中部署的关键障碍。现有持续学习方法主要针对人工神经网络设计,极少同时优化准确率与能效,尤其缺乏对事件基数据集的研究。本文提出一种面向持续SNN学习的能量感知脉冲预算框架,融合经验回放、可学习的漏电积分-发放神经元参数及自适应脉冲调度器,在训练中施加数据集特定的能耗约束。该方法表现出模态依赖行为:在帧基数据集(MNIST、CIFAR-10)上,脉冲预算作为稀疏性正则化器,使脉冲率降低最高达47%,同时提升准确率;在事件基数据集(DVS-Gesture、N-MNIST、CIFAR-10-DVS)上,受控的预算松弛使准确率提升最高达17.45个百分点,计算开销极小。在涵盖两种模态的五个基准测试中,该方法均实现稳定性能提升,并显著降低动态功耗,推动了神经形态视觉系统中持续学习的实际应用。

原文摘要 · Abstract (English)

Neuromorphic vision systems based on spiking neural networks (SNNs) offer ultra-low-power perception for event-based and frame-based cameras, yet catastrophic forgetting remains a critical barrier to deployment in continually evolving environments. Existing continual learning methods, developed primarily for artificial neural networks, seldom jointly optimize accuracy and energy efficiency, with particularly limited exploration on event-based datasets. We propose an energy-aware spike budgeting framework for continual SNN learning that integrates experience replay, learnable leaky integrate-and-fire neuron parameters, and an adaptive spike scheduler to enforce dataset-specific energy constraints during training. Our approach exhibits modality-dependent behavior: on frame-based datasets (MNIST, CIFAR-10), spike budgeting acts as a sparsity-inducing regularizer, improving accuracy while reducing spike rates by up to 47\%; on event-based datasets (DVS-Gesture, N-MNIST, CIFAR-10-DVS), controlled budget relaxation enables accuracy gains up to 17.45 percentage points with minimal computational overhead. Across five benchmarks spanning both modalities, our method demonstrates consistent performance improvements while minimizing dynamic power consumption, advancing the practical viability of continual learning in neuromorphic vision systems.

脉冲神经网络持续学习节能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。