arXiv:2602.20309cs.LG2026-02被引 12

提出首个无需训练的视觉语言动作模型量化框架,实现低比特部署。

QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Models

  • 通过选择性整数化线性层、保持注意力投影浮点,保留原算子调度。
  • 在LIBERO数据集上量化后任务成功率超全精度基线,内存减少约70%。
  • 适合资源受限场景下的智能体部署,尤其适用于扩散模型动作头。

视觉-语言-动作(VLA)模型融合感知、语言与控制能力,但随着模型规模扩大和动作序列变长,计算与内存需求急剧上升,难以实用部署。为此,我们提出QuantVLA,一种无需训练的后训练量化(PTQ)框架,据我们所知是首个应用于VLA系统的PTQ方法,也是首个成功量化扩散变换器(DiT)动作头的方法。QuantVLA包含三个尺度校准组件:(1) 选择性量化布局,将语言骨干和DiT中的所有线性层整数化,同时保持注意力投影为浮点,以保留原始算子调度;(2) 注意力温度匹配,一种轻量级每头缩放机制,在推理时折叠进反量化尺度,稳定注意力对数;(3) 输出头平衡,每层残差接口校准,缓解后投影能量漂移。该框架无需额外训练,仅需少量无标签校准数据,支持低比特权重与激活的整数核运算,且不改变原有架构。在LIBERO上的多类VLA模型测试中,量化后任务成功率超过全精度基线,量化组件内存降低约70%,为严苛算力、内存与功耗约束下的可扩展低比特具身智能提供可行路径。

原文摘要 · Abstract (English)

Vision-language-action (VLA) models unify perception, language, and control for embodied agents but face significant challenges in practical deployment due to rapidly increasing compute and memory demands, especially as models scale to longer horizons and larger backbones. To address these bottlenecks, we introduce QuantVLA, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to successfully quantize a diffusion transformer (DiT) action head. QuantVLA incorporates three scale-calibrated components: (1) a selective quantization layout that integerizes all linear layers in both the language backbone and the DiT while keeping attention projections in floating point to preserve the original operator schedule; (2) attention temperature matching, a lightweight per-head scaling mechanism that stabilizes attention logits and is folded into the dequantization scales at inference; and (3) output head balancing, a per-layer residual interface calibration that mitigates post-projection energy drift. The framework requires no additional training, uses only a small unlabeled calibration buffer, and supports integer kernels for low-bit weights and activations while leaving the architecture unchanged. Across representative VLA models on LIBERO, QuantVLA exceeds the task success rates of full-precision baselines, achieves about 70% relative memory savings on the quantized components, providing a practical pathway toward scalable low-bit embodied intelligence under strict compute, memory, and power constraints.

量化视觉语言具身智能扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。