arXiv:2606.03257cs.NEcs.AI2026-06

提出结构化剪枝方法PSViT,让脉冲视觉Transformer在低功耗设备上高效部署。

PSViT: A Methodology for Structurally Pruning Spiking Vision Transformers

论文配图:PSViT: A Methodology for Structurally Pruning Spiking Vision Transformers
图 1 · 摘自论文原文
  • 通过通道级结构化剪枝,系统性移除冗余权重。
  • 单次剪枝节省22.4%内存,准确率仅下降3%以内。
  • 适配现有计算架构,无需特殊硬件支持。

脉冲视觉变压器(SViT)是性能优异的低功耗视觉模型,但其庞大体积限制了在资源受限嵌入式平台的部署,亟需模型压缩。现有主流压缩方法采用非结构化剪枝,需专用硬件以发挥效率优势,难以推广。为此,本文提出PSViT,一种针对SViT的新型结构化剪枝方法,使模型可借助现有通用计算架构高效加速。PSViT包含三步:统一通道级滤波器剪枝以消除不重要权重,敏感性分析评估各层通道剪枝对精度与网络规模的影响,并基于敏感性与架构设计进行细粒度通道剪枝。实验表明,PSViT在ImageNet-1K上实现22.4%内存节省,单次剪枝后准确率保持在70.3%(未微调)和72.8%(微调),接近原始模型的73.3%,显著推动了低功耗场景下SViT的实用化部署。

原文摘要 · Abstract (English)

Spiking Vision Transformer (SViT) models are promising low-power ViT models for solving vision-based tasks with state-of-the-art performance. However, their large sizes limit their deployments for resource-constrained embedded platforms, underscoring the needs of model compression. One of prominent compression techniques is pruning, and the state-of-the-art works employ unstructured pruning techniques to compress SViT models. Such techniques require specialized hardware architectures tailored for the sparsity patterns to maximize their efficiency benefits, making this approach not scalable. To address this, we propose PSViT, a novel methodology to perform structured pruning on SViT models, hence making it possible to efficiently accelerate their inference using the existing and widely-used computing architectures. To do this, PSViT employs several key steps: uniform channel-wise filter pruning to structurally eliminate the non-significant weights, sensitivity analysis to evaluate the impact of channel-wise pruning of individual layer on accuracy and network size, as well as fine-grained channel-wise pruning based on the sensitivity analysis and the given network architecture. Experimental results show that PSViT effectively obtains 22.4% memory saving through single-shot pruning, while maintaining high accuracy within 3% (70.3% without fine-tuning and 72.8% with fine-tuning) from the original non-pruned SViT model (73.3%) on the ImageNet-1K. These results also show that the PSViT methodology advances the effort in enabling efficient SViT deployments on resource-constrained applications.

神经网络剪枝脉冲神经网络低功耗计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。