arXiv:2504.00948cs.NEcs.AI2025-04中稿 · the International …被引 8

提出QSViT量化方法,让脉冲视觉Transformer在低功耗设备上更轻量高效。

QSViT: A Methodology for Quantizing Spiking Vision Transformers

  • 分层系统性量化,按层选择最优精度以压缩模型
  • 图像识别任务中内存减少22.75%,功耗降低21.33%且精度损失小于2.1%
  • 适合资源受限的嵌入式视觉AI部署,尤其关注能效与模型压缩

基于视觉Transformer(ViT)的模型在视觉智能任务中表现优异,但其庞大的内存占用和复杂计算限制了在资源受限嵌入式AI系统中的应用,导致高功耗。近期出现的脉冲视觉Transformer(SViT)虽为低功耗替代方案,但内存依然过大。为此,本文提出QSViT,一种针对SViT的系统化量化方法,通过四个关键步骤实现压缩:(1) 分析不同网络层对精度的敏感度;(2) 确定基础量化设置;(3) 基于基础设置进行指导性量化;(4) 构建优化后的量化网络。实验表明,该方法在ImageNet数据集上实现22.75%内存节省和21.33%功耗降低,同时保持精度仅比原始非量化SViT低2.1%。结果验证了QSViT在推动资源受限嵌入式系统中高效SViT部署方面的潜力。

原文摘要 · Abstract (English)

Vision Transformer (ViT)-based models have shown state-of-the-art performance (e.g., accuracy) in vision-based AI tasks. However, realizing their capability in resource-constrained embedded AI systems is challenging due to their inherent large memory footprints and complex computations, thereby incurring high power/energy consumption. Recently, Spiking Vision Transformer (SViT)-based models have emerged as alternate low-power ViT networks. However, their large memory footprints still hinder their applicability for resource-constrained embedded AI systems. Therefore, there is a need for a methodology to compress SViT models without degrading the accuracy significantly. To address this, we propose QSViT, a novel design methodology to compress the SViT models through a systematic quantization strategy across different network layers. To do this, our QSViT employs several key steps: (1) investigating the impact of different precision levels in different network layers, (2) identifying the appropriate base quantization settings for guiding bit precision reduction, (3) performing a guided quantization strategy based on the base settings to select the appropriate quantization setting, and (4) developing an efficient quantized network based on the selected quantization setting. The experimental results demonstrate that, our QSViT methodology achieves 22.75% memory saving and 21.33% power saving, while also maintaining high accuracy within 2.1% from that of the original non-quantized SViT model on the ImageNet dataset. These results highlight the potential of QSViT methodology to pave the way toward the efficient SViT deployments on resource-constrained embedded AI systems.

脉冲神经网络模型压缩视觉Transformer低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。