arXiv:2606.03428cs.NEcs.AI2026-06

自动结构化剪枝框架,让脉冲视觉变压器更省内存且易部署。

PrimeSVT: An Automated Memory-aware Pruning Framework with Prioritized Compression Policy for Spiking Vision Transformers

论文配图:PrimeSVT: An Automated Memory-aware Pruning Framework with Prioritized Compression Policy for Spiking Vision Transformers
图 1 · 摘自论文原文
  • 按层大小排序+重要性优先剪枝,实现自动化压缩。
  • 单次剪枝节省26.68%内存,精度损失小于3%。
  • 适合资源受限设备上的脉冲神经网络部署。

脉冲视觉变压器(SViTs)模型体积庞大,阻碍其在嵌入式设备上的应用,亟需模型压缩。现有方法采用非结构化剪枝,依赖专用硬件加速器以实现高效计算,且需手动调参,设计成本高,难以扩展。为此,本文提出PrimeSVT,一种面向预训练SViT模型的自动化内存感知结构化剪枝框架,通过优先压缩策略提升推理效率,适配通用计算架构。该框架首先按参数量对各层排序,基于不同剪枝率下的鲁棒性识别目标剪枝层,然后从最大层到最小层逐层压缩,同时满足用户设定的精度与内存约束。每层采用基于L2范数的通道级滤波剪枝,结构化移除不重要权重。实验表明,单次剪枝可节省26.68%内存,精度保持在原始模型(73.3%)的70.3%(未微调)至72.9%(微调)之间,满足精度与内存约束。证明了PrimeSVT能实现SViT设计自动化与嵌入式部署。

原文摘要 · Abstract (English)

The large sizes of Spiking Vision Transformers (SViTs) still hinder their embedded implementation, highlighting the need for model compression. State-of-the-art works compress SViT models through unstructured pruning, which needs specialized hardware accelerators for their specific sparsity patterns to maximize efficiency gains. Moreover, their manual approach requires a huge design time to find an appropriate pruning setting for each network, thus making this approach not scalable. To address this limitation, we propose PrimeSVT, a novel framework that performs automated memory-aware structured pruning on pre-trained SViT models, thereby maximizing their efficiency gains during inference amenable to widely-used computing architectures. To achieve this, PrimeSVT first sorts the SViT layers based on their sizes (i.e., number of parameters), identifies the targeted pruning layers based on their robustness under different pruning rates, then leverages this order for compressing the model layer-by-layer sequentially from the largest one to the smallest one (i.e., so-called prioritized compression policy), while considering the user-defined constraints (i.e., acceptable accuracy and memory saving). In each layer, PrimeSVT employs channel-wise filter pruning based on their L2-norm values to structurally remove the non-significant weights. Experimental results show that PrimeSVT saves 26.68% memory through automated single-shot pruning, while preserving accuracy within 3% (70.3% without fine-tuning and 72.9% with fine-tuning) from the original unpruned SViT model (73.3%), thus meeting the accuracy and memory constraints. These show that our PrimeSVT framework enables design automation for SViTs and their embedded implementation.

脉冲神经网络模型压缩自动化剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。