arXiv:2505.18608cs.CV2025-05NeurIPS被引 11

发现脉冲神经网络因抑制高频信息导致性能下降,提出增强高频信号的新架构。

Spiking Neural Networks Need High Frequency Information

  • 通过高频增强机制,改进脉冲神经网络的特征表达能力。
  • 在ImageNet上达82.39%准确率,优于现有方法7.58个百分点。
  • 适用于脉冲视觉任务,尤其适合追求能效与精度平衡的研究者。

脉冲神经网络(SNN)通过二进制脉冲传递信息,具备类脑与低功耗优势,但性能仍落后于人工神经网络,通常归因于稀疏和二值化激活导致的信息损失。本文挑战这一长期假设,揭示了脉冲神经元存在被忽视的频率偏差:其天然抑制高频成分,优先传播低频信息。这种频率域失衡是导致特征表示退化的根本原因。实验显示,在脉冲Transformer中,使用平均池化(低通)使Cifar-100准确率降至76.73%,而替换为最大池化(高通)后提升至79.12%。为此,我们提出Max-Former,通过两种频率增强操作恢复高频信号:(1)在图像嵌入中引入额外最大池化,(2)用深度卷积替代自注意力。Max-Former仅用63.99M参数即在ImageNet上达到82.39%的顶级准确率,超越Spikformer(74.81%,66.34M)7.58%。拓展至卷积网络,Max-ResNet-18在CIFAR-10和CIFAR-100分别取得97.17%和83.06%的最新成果。代码已开源。

原文摘要 · Abstract (English)

Spiking Neural Networks promise brain-inspired and energy-efficient computation by transmitting information through binary (0/1) spikes. Yet, their performance still lags behind that of artificial neural networks, often assumed to result from information loss caused by sparse and binary activations. In this work, we challenge this long-standing assumption and reveal a previously overlooked frequency bias: spiking neurons inherently suppress high-frequency components and preferentially propagate low-frequency information. This frequency-domain imbalance, we argue, is the root cause of degraded feature representation in SNNs. Empirically, on Spiking Transformers, adopting Avg-Pooling (low-pass) for token mixing lowers performance to 76.73% on Cifar-100, whereas replacing it with Max-Pool (high-pass) pushes the top-1 accuracy to 79.12%. Accordingly, we introduce Max-Former that restores high-frequency signals through two frequency-enhancing operators: (1) extra Max-Pool in patch embedding, and (2) Depth-Wise Convolution in place of self-attention. Notably, Max-Former attains 82.39% top-1 accuracy on ImageNet using only 63.99M parameters, surpassing Spikformer (74.81%, 66.34M) by +7.58%. Extending our insight beyond transformers, our Max-ResNet-18 achieves state-of-the-art performance on convolution-based benchmarks: 97.17% on CIFAR-10 and 83.06% on CIFAR-100. We hope this simple yet effective solution inspires future research to explore the distinctive nature of spiking neural networks. Code is available: https://github.com/bic-L/MaxFormer.

脉冲神经网络频率增强图像分类能效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。