arXiv:2506.07530cs.ROcs.CV2025-06被引 37

1-bit模型让机器人在低内存设备上实现高效精准操作。

BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation

  • 全参数仅用{-1,0,1}三值表示,极大压缩模型体积。
  • 在仿真与真实任务中性能媲美全精度模型,内存减少11倍、延迟降低4.4倍。
  • 适合资源受限的边缘机器人部署,兼顾效率与表现。

将强大的视觉-语言-动作(VLA)模型部署到边缘设备受限于其巨大规模。本文从部署角度出发,通过模型设计与优化实现效率提升,而非依赖事后压缩。提出BitVLA,一种面向机器人操作的全1比特VLA模型,所有参数均为三值({-1,0,1})。BitVLA基于公开的1比特大语言模型BitNet b1.58 2B4T构建,并训练为视觉-语言-动作策略,继承1比特预训练的紧凑性,同时保持强任务性能。为进一步降低视觉主干网络内存开销,引入“量化解耦-蒸馏”策略:在后训练阶段采用量化感知训练,将全精度视觉编码器压缩至1.58比特权重,同时由全精度教师模型引导表征对齐。在仿真基准和真实任务中,BitVLA性能与全精度OpenVLA-OFT基线相当,模型内存减少11.0倍,端到端延迟降低4.4倍。结果表明,该方法为具身策略提供了训练时效率-精度协同设计的可行路径,使内存受限的边缘机器人平台具备竞争力的操作能力。代码开源地址:https://github.com/ustcwhy/BitVLA,模型权重:https://huggingface.co/lxsy/bitvla-bf16。

原文摘要 · Abstract (English)

Deploying powerful Vision-Language-Action (VLA) models on edge devices is limited by their massive size. In this paper, we take a deployment-oriented view of VLA training: we target efficiency through model design and optimization, rather than relying solely on post-hoc compression. Thus, we propose BitVLA, a fully native 1-bit VLA model for robotic manipulation, where every parameters is ternary, i.e., {-1,0,1}. BitVLA is built on the publicly available 1-bit LLM BitNet b1.58 2B4T, and is trained as a vision-language-action policy that inherits the compactness of 1-bit pretraining while retaining strong task performance. To further reduce the memory footprint of the vision backbone, we introduce Quantize-then-Distill, a post-training quantization-aware training strategy that compresses a full-precision vision encoder to 1.58-bit weights, while a full-precision teacher guides representation alignment during training. Across simulation benchmarks and real-world tasks, BitVLA matches the performance of the full-precision OpenVLA-OFT baseline, while reducing model memory by 11.0x and end-to-end latency by 4.4x. These results suggest a practical path toward training-time efficiency-accuracy co-design for embodied policies, enabling competitive manipulation capability on memory-constrained edge robotic platforms. We release the code in https://github.com/ustcwhy/BitVLA, model weights in https://huggingface.co/lxsy/bitvla-bf16.

1比特模型机器人操作边缘部署压缩算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。