提出HBVLA框架,实现视觉-语言-动作模型的1比特量化,显著提升机器人部署效率。
HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Models
- 基于策略感知的海森矩阵识别关键权重,精准定位影响动作的核心参数。
- 在真实世界任务中,量化后模型性能保留率达92.2%~93.6%,优于现有方法。
- 适用于资源受限机器人平台,支持低功耗、高可靠性的边缘部署。
视觉-语言-动作(VLA)模型可实现指令驱动的具身控制,但其庞大的计算与内存开销限制了在资源受限机器人和边缘设备上的部署。尽管通过二值化将权重降至1比特可大幅提升效率,但现有方法无法弥合二值化与全精度权重间的分布差距,导致在长时闭环执行中量化误差累积,严重损害动作表现。为此,我们提出针对VLA的二值化框架HBVLA:首先使用策略感知增强的海森矩阵识别真正关键的权重;其次对非显著权重施加稀疏正交变换,诱导低熵中间状态;最后在哈达玛域内采用分组1比特量化,同时处理显著与非显著权重。我们在多个VLAs上进行评估:在LIBERO数据集上,量化后的OpenVLA-OFT保留92.2%的全精度性能;在SimplerEnv上,量化后的CogAct保留93.6%,显著优于当前最优二值化方法。进一步在真实世界评估套件中验证,HBVLA仅造成微小成功率下降,证明其在严苛硬件约束下的鲁棒可部署性。本工作为超低比特量化提供实用基础,助力更多受限硬件平台的可靠应用。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models enable instruction-following embodied control, but their large compute and memory footprints hinder deployment on resource-constrained robots and edge platforms. While reducing weights to 1-bit precision through binarization can greatly improve efficiency, existing methods fail to narrow the distribution gap between binarized and full-precision weights, causing quantization errors to accumulate under long-horizon closed-loop execution and severely degrade actions. To fill this gap, we propose HBVLA, a VLA-tailored binarization framework. First, we use a policy-aware enhanced Hessian to identify weights that are truly critical for action generation. Then, we employ a sparse orthogonal transform for non-salient weights to induce a low-entropy intermediate state. Finally, we quantize both salient and non-salient weights in the Harr domain with group-wise 1-bit quantization. We have evaluated our approach on different VLAs: on LIBERO, quantized OpenVLA-OFT retains 92.2% of full-precision performance; on SimplerEnv, quantized CogAct retains 93.6%, significantly outperforming state-of-the-art binarization methods. We further validate our method on real-world evaluation suite and the results show that HBVLA incurs only marginal success-rate degradation compared to the full-precision model, demonstrating robust deployability under tight hardware constraints. Our work provides a practical foundation for ultra-low-bit quantization of VLAs, enabling more reliable deployment on hardware-limited robotic platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。