arXiv:2504.02298cs.LG2025-04NeurIPS被引 4

针对脉冲神经网络设计首个无需源数据的测试时自适应方法。

SPACE: SPike-Aware Consistency Enhancement for Test-Time Adaptation in Spiking Neural Networks

  • 利用脉冲行为一致性增强实现单样本自适应。
  • 在多个架构上提升性能,优于现有脉冲神经网络方法。
  • 适合部署在资源受限的生物启发式神经网络场景中。

脉冲神经网络(SNNs)作为人工神经网络(ANNs)的生物合理替代方案,在能效、时间处理和生物可解释性方面具有优势。然而,SNNs对分布偏移极为敏感,严重影响其在真实场景中的表现。传统为ANN设计的测试时自适应(TTA)方法难以应对SNN特有的稀疏性和时间脉冲特性。为此,我们提出首个无源数据、单实例的SNN专用TTA方法——空间感知一致性增强(SPACE)。SPACE利用SNN固有的脉冲动态,在单个测试样本的不同增强版本间最大化基于脉冲行为的局部特征图一致性,实现无需源数据的鲁棒自适应。我们在多个数据集上评估了SPACE,结果表明其在CNN、Transformer和ConvLSTM等多种架构上均表现出稳健的泛化能力,显著提升SNN性能,同时计算开销低于现有先进ANN方法,验证了其在真实场景下的有效性与鲁棒性。代码将发布于https://github.com/ethanxyluo/SPACE。

原文摘要 · Abstract (English)

Spiking Neural Networks (SNNs), as a biologically plausible alternative to Artificial Neural Networks (ANNs), have demonstrated advantages in terms of energy efficiency, temporal processing, and biological plausibility. However, SNNs are highly sensitive to distribution shifts, which can significantly degrade their performance in real-world scenarios. Traditional test-time adaptation (TTA) methods designed for ANNs often fail to address the unique computational dynamics of SNNs, such as sparsity and temporal spiking behavior. To address these challenges, we propose SPike-Aware Consistency Enhancement (SPACE), the first source-free and single-instance TTA method specifically designed for SNNs. SPACE leverages the inherent spike dynamics of SNNs to maximize the consistency of spike-behavior-based local feature maps across augmented versions of a single test sample, enabling robust adaptation without requiring source data. We evaluate SPACE on multiple datasets. Furthermore, SPACE exhibits robust generalization across diverse network architectures, consistently enhancing the performance of SNNs on CNNs, Transformer, and ConvLSTM architectures. Experimental results show that SPACE outperforms state-of-the-art ANN methods while maintaining lower computational cost, highlighting its effectiveness and robustness for SNNs in real-world settings. The code will be available at https://github.com/ethanxyluo/SPACE.

脉冲神经网络测试时自适应能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。