arXiv:2510.00600cs.ROcs.AI2025-10被引 2

让视觉语言动作模型学会用思维链提升性能,推理时可跳过思维直接行动。

Hybrid Training for Vision-Language-Action Models

  • 训练时融合思维链数据,学习生成思考过程
  • 推理时可选择跳过思维直接输出动作,提速明显
  • 支持多种推理模式,灵活适应不同场景需求

使用大型语言模型生成中间思考(即思维链,CoT)以辅助回答复杂语言任务已证明有效。在机器人领域,类似具身思维链策略——在执行动作前生成思考——也被证实能提升视觉-语言-动作模型(VLAs)的性能。然而,这类方法会显著增加模型输出长度,导致推理时间延长。在实际机器人操作中延迟行动会严重影响可用性,因任务需长时间序列动作。那么,生成长思维链是否是性能提升的必要条件?本文提出混合训练(Hybrid Training, HyT)框架,使VLAs能在训练中学习思考过程并获得性能增益,同时允许推理阶段跳过思考生成。此外,通过学习有条件地预测多样输出,HyT支持推理时灵活选择:直接预测动作、生成思考或遵循指令。我们在一系列仿真基准和真实世界实验中评估该方法。

原文摘要 · Abstract (English)

Using Large Language Models to produce intermediate thoughts, a.k.a. Chain-of-thought (CoT), before providing an answer has been a successful recipe for solving complex language tasks. In robotics, similar embodied CoT strategies, generating thoughts before actions, have also been shown to lead to improved performance when using Vision-Language-Action models (VLAs). As these techniques increase the length of the model's generated outputs to include the thoughts, the inference time is negatively affected. Delaying an agent's actions in real-world executions, as in robotic manipulation settings, strongly affects the usability of a method, as tasks require long sequences of actions. However, is the generation of long chains-of-thought a strong prerequisite for achieving performance improvements? In this work, we explore the idea of Hybrid Training (HyT), a framework that enables VLAs to learn from thoughts and benefit from the associated performance gains, while enabling the possibility to leave out CoT generation during inference. Furthermore, by learning to conditionally predict a diverse set of outputs, HyT supports flexibility at inference time, enabling the model to either predict actions directly, generate thoughts or follow instructions. We evaluate the proposed method in a series of simulated benchmarks and real-world experiments.

视觉语言动作思维链机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。