让机器人模型学会像人一样思考动作逻辑,提升复杂任务的执行能力。
ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning

- 用专家模型生成动作推理过程,指导机器人模型学习决策逻辑。
- 在模拟任务中成功率超越现有最优方法,尤其在长时序操作上表现更优。
- 适合需要高可解释性与泛化能力的复杂机器人控制场景。
视觉-语言-动作(VLA)模型因其能将多模态观测与语言指令转化为机器人动作而备受关注。然而,现有VLA模型通常忽略显式推理过程,仅学习输入到动作的映射,缺乏关键逻辑步骤,在复杂、长时序操作任务中可解释性和泛化能力不足。本文提出ReFineVLA,一种基于教师引导推理的多模态推理感知框架。首先,利用专家教师模型为机器人数据集添加推理理由;随后,以增强推理的数据对预训练VLA进行微调,既保持原有泛化能力,又显著提升推理能力。通过注意力图可视化分析,发现模型能有效对齐视觉、语言与动作之间的关联。在SimplerEnv仿真环境上的WidowX和Google Robot任务测试中,ReFineVLA在多个基准上取得当前最优性能,成功率优于次优方法。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their advancements, VLAs often overlook explicit reasoning and learn the functional input-action mappings, omitting crucial logical steps, which are especially pronounced in interpretability and generalization for complex, long-horizon manipulation tasks. In this work, we propose ReFineVLA, a multimodal reasoning-aware framework that fine-tunes VLAs with teacher-guided reasons. We first augment robotic datasets with reasoning rationales generated by an expert teacher model, guiding VLA models to learn to reason about their actions. Then, we fine-tune pre-trained VLAs with the reasoning-enriched datasets with ReFineVLA, while maintaining the underlying generalization abilities and boosting reasoning capabilities. We also conduct attention map visualization to analyze the alignment among visual observation, linguistic prompts, and to-be-executed actions of ReFineVLA, reflecting the model is ability to focus on relevant tasks and actions. Through this additional step, we explore that ReFineVLA-trained models exhibit a meaningful agreement between vision-language and action domains, highlighting the enhanced multimodal understanding and generalization. Evaluated across a suite of simulated manipulation benchmarks on SimplerEnv with both WidowX and Google Robot tasks, ReFineVLA achieves state-of-the-art performance, in success rate over the second-best method on the both the WidowX benchmark and Google Robot Tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。