arXiv:2603.00527cs.CV2026-03被引 4

通过剪枝关键信息保留机制,让脉冲神经网络更省电高效。

TP-Spikformer: Token Pruned Spiking Transformer

  • 基于时空信息重要性评估,动态保留高价值令牌
  • 无需重新训练,即可在多个模型上降低计算开销
  • 适合部署在资源受限设备上的脉冲神经网络优化

脉冲神经网络(SNNs)因其事件驱动计算模式,在能效方面优于传统神经网络。然而,近期脉冲变压器的发展多聚焦于提升精度的大规模架构,导致计算资源消耗大,难以在资源受限设备上部署。本文提出一种简单有效的令牌剪枝方法TP-Spikformer,可在保持竞争力性能的同时降低存储与计算开销。我们首先引入一种启发式时空信息保留准则,综合评估令牌重要性:对信息量高的令牌赋予更高保留分值,对无意义令牌则低分处理。基于此准则,设计了一种信息保留型剪枝框架,采用块级提前停止策略替代直接移除无用令牌,从而在剪枝过程中保留更多信息。我们在多种架构(Spikformer、QKFormer、Spike-driven Transformer V1/V3)及任务(图像分类、目标检测、语义分割、事件驱动目标追踪)中进行了广泛实验,验证了该方法的有效性、高效性与可扩展性。特别地,其在无需训练的情况下表现优异,展现出在实际资源受限场景中部署SNN的潜力。

原文摘要 · Abstract (English)

Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in spiking transformers have focused on improving accuracy with large-scale architectures, which require significant computational resources and limit deployment on resource-constrained devices. In this paper, we propose a simple yet effective token pruning method for spiking transformers, termed TP-Spikformer, that reduces storage and computational overhead while maintaining competitive performance. Specifically, we first introduce a heuristic spatiotemporal information-retaining criterion that comprehensively evaluates tokens' importance, assigning higher scores to informative tokens for retention and lower scores to uninformative ones for pruning. Based on this criterion, we propose an information-retaining token pruning framework that employs a block-level early stopping strategy for uninformative tokens, instead of removing them outright. This also helps preserve more information during token pruning. We demonstrate the effectiveness, efficiency and scalability of TP-Spikformer through extensive experiments across diverse architectures, including Spikformer, QKFormer and Spike-driven Transformer V1 and V3, and a range of tasks such as image classification, object detection, semantic segmentation and event-based object tracking. Particularly, TP-Spikformer performs well in a training-free manner. These results reveal its potential as an efficient and practical solution for deploying SNNs in real-world applications with limited computational resources.

脉冲神经网络模型剪枝节能计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。