无需微调,让脉冲神经网络自适应不同时间分辨率。
Zero-Shot Temporal Resolution Domain Adaptation for Spiking Neural Networks
- 基于状态空间模型映射,动态调整神经元参数以适应时间分辨率变化。
- 在时间分辨率翻倍时,准确率最高提升至89.5%(原为53.0%)。
- 适合部署在类脑芯片上且无法获取目标数据的低资源场景。
脉冲神经网络(SNNs)是生物启发的深度神经网络,能在类脑设备上高效提取时序信息并实现低功耗、低延迟。但其参数对时间分辨率敏感,当部署时的目标数据分辨率与训练数据不一致时,性能显著下降,尤其在无法进行微调的情况下。为此,本文提出三种新型无监督域适应方法,通过将SNN神经元动态与状态空间模型(SSMs)建立映射,无需重新训练即可适配不同时间分辨率,适用于通用神经元模型。我们在时空任务上评估了该方法,包括音频关键词识别数据集SHD和MSWC,以及类脑图像数据集NMNIST。结果表明,所提方法优于仅缩放时间常数的基准方法:在目标分辨率翻倍时,SHD上准确率从53.0%提升至89.5%,MSWC从38.8%提升至93.6%,NMNIST从97.2%提升至98.5%。此外,仅在低分辨率数据上高效训练即可获得高分辨率下的高精度表现。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are biologically-inspired deep neural networks that efficiently extract temporal information while offering promising gains in terms of energy efficiency and latency when deployed on neuromorphic devices. SNN parameters are sensitive to temporal resolution, leading to significant performance drops when the temporal resolution of target data during deployment is not the same as that of the source data used for training, especially when fine-tuning with the target data is not possible during deployment. To address this challenge, we propose three novel domain adaptation methods for adapting neuron parameters to account for the change in time resolution without re-training on target time resolution. The proposed methods are based on a mapping between neuron dynamics in SNNs and State Space Models (SSMs) and are applicable to general neuron models. We evaluate the proposed methods under spatio-temporal data tasks, namely the audio keyword spotting datasets SHD and MSWC, and the neuromorphic image NMINST dataset. Our methods provide an alternative to-and in most cases significantly outperform-the existing reference method that consists of scaling only the time constant. Notably, when the temporal resolution of the target data is double that of the source data, applying one of our proposed methods instead of the benchmark achieves classification accuracy of 89.5% instead of 53.0% on SHD, 93.6% instead of 38.8% on MSWC and 98.5% instead of 97.2% aon NMNIST. Moreover, our results show that high accuracy on high temporal resolution data can be obtained by time-efficient training on lower temporal resolution data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。