arXiv:2507.02901cs.NEcs.CV2025-07被引 3

用脉冲神经网络和睡眠增强重放,让边缘设备持续学习更省内存、不偏新任务。

Online Continual Learning via Spiking Neural Networks with Sleep Enhanced Latent Replay

  • 用脉冲神经网络的二进制脉冲存重放特征,内存开销极低。
  • 在分裂CIFAR10上平均准确率提升近30%,内存仅为基线1/3。
  • 适合资源受限的边缘持续学习场景,如智能传感器、机器人。

边缘计算场景需要高效硬件支持的在线持续学习算法以适应动态环境。现有方法常面临高内存开销和对新任务的偏好问题。本文提出新型在线持续学习方法SESRL,结合脉冲神经网络(SNNs)与睡眠增强潜在重放机制。SESRL利用SNN的二进制脉冲特性,仅用单比特存储重放特征,显著降低内存消耗。同时,受生物睡眠-清醒周期启发,引入噪声增强的睡眠阶段,模型仅在带可控噪声注入的重放样本上训练,有效缓解对新类别的分类偏差。在常规数据集(MNIST、CIFAR10)和类脑数据集(NMNIST、CIFAR10-DVS)上的大量实验表明,该方法效果显著。在分裂CIFAR10上,平均准确率提升近30%,内存消耗仅为基线方法的三分之一;在分裂CIFAR10-DVS上,准确率提升约10%,内存开销降低32倍。这些结果验证了SESRL在资源受限边缘计算场景中作为在线持续学习有效解决方案的潜力。

原文摘要 · Abstract (English)

Edge computing scenarios necessitate the development of hardware-efficient online continual learning algorithms to be adaptive to dynamic environment. However, existing algorithms always suffer from high memory overhead and bias towards recently trained tasks. To tackle these issues, this paper proposes a novel online continual learning approach termed as SESLR, which incorporates a sleep enhanced latent replay scheme with spiking neural networks (SNNs). SESLR leverages SNNs' binary spike characteristics to store replay features in single bits, significantly reducing memory overhead. Furthermore, inspired by biological sleep-wake cycles, SESLR introduces a noise-enhanced sleep phase where the model exclusively trains on replay samples with controlled noise injection, effectively mitigating classification bias towards new classes. Extensive experiments on both conventional (MNIST, CIFAR10) and neuromorphic (NMNIST, CIFAR10-DVS) datasets demonstrate SESLR's effectiveness. On Split CIFAR10, SESLR achieves nearly 30% improvement in average accuracy with only one-third of the memory consumption compared to baseline methods. On Split CIFAR10-DVS, it improves accuracy by approximately 10% while reducing memory overhead by a factor of 32. These results validate SESLR as a promising solution for online continual learning in resource-constrained edge computing scenarios.

持续学习脉冲神经网络边缘计算内存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。