用纯文本表示动作,零修改现成模型,效果竟超复杂设计
VLA-0: Building State-of-the-Art VLAs with Zero Modification
- 直接用文本描述动作,不改模型结构或词汇表
- 在LIBERO基准上超越所有同类模型,包括大模型训练版本
- 无需大规模机器人数据预训练,实机表现也优于强基线
视觉-语言-动作模型(VLAs)在通用机器人操作中前景广阔,但最优构建方式仍不明确。当前方法常通过添加动作标记或专用头部引入复杂性。本文提出VLA-0,探索将动作直接以文本形式表示的简单策略。结果发现,只要设计得当,该方法不仅有效,且性能惊人:在主流基准LIBERO上,其表现超越所有基于相同机器人数据训练的现有方法,包括$π_0.5$-KI、OpenVLA-OFT和SmolVLA;即使未使用大规模机器人数据预训练,也优于$π_0.5$-KI、$π_0$、GR00T-N1和MolmoAct等模型。这些优势在真实场景中同样成立,其表现超过基于大规模真实数据预训练的SmolVLA。本文总结了这一意外发现,并揭示实现高性能的关键技术细节。代码、模型与可视化结果见:https://vla0.github.io/
原文摘要 · Abstract (English)
Vision-Language-Action models (VLAs) hold immense promise for enabling generalist robot manipulation. However, the best way to build them remains an open question. Current approaches often add complexity, such as modifying the existing vocabulary of a Vision-Language Model (VLM) with action tokens or introducing special action heads. Curiously, the simplest strategy of representing actions directly as text has remained largely unexplored. This work introduces VLA-0 to investigate this idea. We find that VLA-0 is not only effective; it is surprisingly powerful. With the right design, VLA-0 outperforms more involved models. On LIBERO, a popular benchmark for evaluating VLAs, VLA-0 outperforms all existing methods trained on the same robotic data, including $π_0.5$-KI, OpenVLA-OFT and SmolVLA. Furthermore, without large-scale robotics-specific training, it outperforms methods trained on large-scale robotic data, like $π_0.5$-KI, $π_0$, GR00T-N1 and MolmoAct. These findings also translate to the real world, where VLA-0 outperforms SmolVLA, a VLA model pre-trained on large-scale real data. This paper summarizes our unexpected findings and spells out the specific techniques required to unlock the high performance of this simple yet potent VLA design. Visual results, code, and trained models are provided here: https://vla0.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。