arXiv:2605.28803cs.CVcs.LG2026-05

首次实现视觉语言动作模型全模型4比特量化,保持高精度控制。

HoloQ-VLA: Uniform W4A4 Quantization of Vision-Language-Action Models

论文配图:HoloQ-VLA: Uniform W4A4 Quantization of Vision-Language-Action Models
图 1 · 摘自论文原文
  • 用旋转与哈达玛变换协同消除权重和激活异常值
  • 在LIBERO上实现98.0%任务成功率,内存减少74.2%
  • 适合需要轻量化部署的机器人控制场景

视觉-语言-动作(VLA)模型将感知、推理与控制统一于单一策略中,但其多十亿参数的骨干网络和基于扩散的动作头使得设备端部署成本极高。低比特后训练量化(PTQ)是自然解决方案,然而扩散动作头输出连续控制信号,对量化极为敏感:少量权重与激活异常值即可导致其不稳定,以往工作只能保留全精度或采用混合精度方案,统一低比特量化仍属难题。本文提出HoloQ-VLA,首个无需训练的PTQ框架,可将语言骨干与整个扩散动作头统一压缩至W4A4精度,无需混合精度分配。通过权重自适应旋转与激活分散型哈达玛变换,结合每步缩放以缓解动作头在去噪过程中的动态范围漂移。在LIBERO数据集上,HoloQ-VLA将Pi-0.5与GR00T-N1.5压缩至W4A4后,任务成功率分别达98.0%和87.8%,匹配或超越其FP16参考表现(97.1%和87.0%),静态内存减少74.2%。真实世界操作实验表明,该方法在多种场景下仍能维持平滑精准的控制。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models unify perception, reasoning, and control in a single policy, but their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive. Low-bit post-training quantization (PTQ) is the natural remedy, yet the diffusion action head that emits continuous control signals is highly sensitive to it: a few weight and activation outliers are enough to destabilize the head, so prior work leaves it at full precision or falls back to mixed-precision schemes, and uniformly quantizing the whole model to low bit-width remains an open challenge. We present HoloQ-VLA, the first training-free PTQ framework that compresses both the language backbone and the entire diffusion action head to uniform W4A4 precision without mixed-precision allocation. Instead of trading weight quality against activation quality, HoloQ-VLA targets the two outlier sources with complementary transforms: a weight-adapted rotation composed with an activation-dispersing Hadamard transform, together with per-step scaling that absorbs the dynamic-range drift exhibited by the action head across denoising steps. On LIBERO, HoloQ-VLA compresses Pi-0.5 and GR00T-N1.5 to W4A4 with 98.0% and 87.8% task success rates, matching or exceeding their FP16 references of 97.1% and 87.0%, while reducing the static memory footprint by 74.2%. Real-world manipulation experiments further demonstrate that HoloQ-VLA maintains smooth and accurate control across diverse real-world scenarios.

量化机器人控制扩散模型轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。