提出轻量级量化方法,让视觉语言动作模型在边缘设备上高效运行。
ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models

- 按动作重要性动态分配权重位宽,实现混合精度量化
- 2.5比特下仍保持90.1%性能,模型压缩5.3倍
- 支持真实机械臂部署,内存减少2.5倍且成功率不变
视觉-语言-动作(VLA)模型在具身智能中表现出色,但计算开销大,难以在边缘设备部署。本文提出ActQuant,一种面向动作的混合精度后训练量化框架,分两阶段:(1) 基于对动作预测的贡献度,为每个权重矩阵分配单一比特位宽;(2) 利用动作感知曲率优化每块量化尺度,使动态范围集中在对控制影响最大的权重上。为实现设备端优势,进一步推出OmniModel.cpp,将模型转化为原生C/C++运行时并配备高效低比特内核。在模拟与真实6自由度UR3机械臂上评估,所有模型均通过OmniModel.cpp部署。在LIBERO基准上,ActQuant是唯一能在或低于3比特/权下运行的方法,保留OpenVLA-OFT的95.0%和$π_{0.5}$的94.8%性能;进一步推进至2.5比特/权时,仍保持OpenVLA-OFT的90.1%性能,主干模型从14.3 GB压缩至2.7 GB(5.3×)。在物理UR3臂上,$π_{0.5}$量化后成功率与基线一致,内存减少2.5倍。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models exhibit remarkable action generation for embodied intelligence, but their heavy compute make deployment on edge platforms impractical. Aggressive, sub-4-bit weight quantization is the natural solution, yet existing post-training quantization (PTQ) methods suffer severe performance degradation in this regime. To address this, we introduce ActQuant, an action-guided mixed-precision PTQ framework that operates in two stages: (1) an inter-tensor bit allocator that assigns each weight matrix a single bit-width based on how much it contributes to predicting the agent's actions; (2) an intra-tensor scale optimizer tunes per-block quantization scales using action-aware curvature, so that dynamic range is concentrated on the weights most influential for control. To deliver the on-device benefits of our aggressive quantization, we further introduce OmniModel.cpp, an agentic conversion pipeline that ports architectures into a native C/C++ runtime with efficient low-bit kernels. We evaluate ActQuant both in simulation and on a real-world 6-DoF UR3 arm, with all models deployed through OmniModel.cpp. On the LIBERO benchmark, ActQuant is the only method that operates at or below 3 bits-per-weight, retaining 95.0% on OpenVLA-OFT and 94.8% on $π_{0.5}$. Pushed further, ActQuant reaches 2.5 bpw at 90.1% on OpenVLA-OFT, compressing the backbone from 14.3 GB to 2.7 GB (5.3$\times$). On the physical UR3 arm, $π_{0.5}$ quantized with ActQuant retains the baseline's success rate while reducing the memory footprint by 2.5$\times$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。