提出无需梯度的脉冲神经网络持续学习方法,实现零遗忘。
Gradient-Free Continual Learning in Spiking Neural Networks via Inter-Spike Interval Regularization
- 基于峰间间隔变异系数设计无梯度重要性评估机制
- 在多个数据集上实现0%遗忘率,真实事件数据下准确率达82%
- 专为类脑芯片设计,仅需整数运算,适合部署于边缘设备
持续学习使神经网络能顺序获取新任务而不遗忘旧知识,对核数字孪生监控、电网边缘故障检测等动态环境至关重要。现有基于梯度的权重重要性方法(如EWC、SI)无法在缺乏反向传播支持的类脑硬件上运行。本文提出ISI-CV,首个适用于脉冲神经网络持续学习的无梯度重要性度量,其基于峰间间隔(ISI)变异系数(CV):规律放电(低CV)的神经元保留稳定特征,防止被覆盖;不规则放电的神经元可自由适应。ISI-CV仅需脉冲时间计数器与整数运算,所有类脑芯片原生支持。在四个难度递增的基准测试中评估:Split-MNIST、Permuted-MNIST、Split-FashionMNIST及使用真实动态视觉传感器(DVS)事件数据的Split-N-MNIST。三次随机种子实验显示,ISI-CV在Split-MNIST和Split-FashionMNIST上实现零遗忘(AF = 0.000 ± 0.000),在Permuted-MNIST上接近零遗忘(AF = 0.001 ± 0.000),在真实DVS数据上取得最高准确率(AA = 0.820 ± 0.012)与最低遗忘率(AF = 0.221 ± 0.014)。在N-MNIST上,基于梯度的方法因估计不可靠而表现更差;ISI-CV则避免该缺陷。
原文摘要 · Abstract (English)
Continual learning, the ability to acquire new tasks sequentially without forgetting prior knowledge, is essential for deploying neural networks in dynamic real-world environments, from nuclear digital twin monitoring to grid-edge fault detection. Existing synaptic importance methods, such as Elastic Weight Consolidation (EWC) and Synaptic Intelligence (SI), rely on gradient computation, making them incompatible with neuromorphic hardware that lacks backpropagation support. We propose ISI-CV, the first gradient-free synaptic importance metric for SNN continual learning, derived from the Coefficient of Variation (CV) of Inter-Spike Intervals (ISIs). Neurons that fire regularly (low CV) encode stable, task-relevant features and are protected from overwriting; neurons with irregular firing are permitted to adapt freely. ISI-CV requires only spike time counters and integer arithmetic, all of which are native to every neuromorphic chip. We evaluate on four benchmarks of increasing difficulty: Split-MNIST, Permuted-MNIST, Split-FashionMNIST, and Split-N-MNIST using real Dynamic Vision Sensor (DVS) event data. Across three seeds, ISI-CV achieves zero forgetting (AF = 0.000 +/- 0.000) on Split-MNIST and Split-FashionMNIST, near-zero forgetting on Permuted-MNIST (AF = 0.001 +/- 0.000), and the highest accuracy with the lowest forgetting on real neuromorphic DVS data (AA = 0.820 +/- 0.012, AF = 0.221 +/- 0.014). On N-MNIST, gradient-based methods produce unreliable importance estimates and perform worse than no regularization; ISI-CV avoids this failure by design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。