通过追踪任务优化视觉条件,提升视觉-语言-动作模型的可靠性。
VISTA: Enhancing Visual Conditioning via Track-Following Preference Optimization in Vision-Language-Action Models
- 用追踪任务偏好优化强化视觉对动作的依赖
- 在离散与连续动作空间均提升视觉条件性与任务表现
- 无需修改结构或新数据,适合机器人操控场景
视觉-语言-动作(VLA)模型在多种机器人操作任务中表现出色。然而,将大型预训练视觉-语言模型(VLM)扩展到动作空间时,常出现视觉-动作错位问题,即动作预测对当前视觉状态依赖弱,导致输出不可靠。本文从视觉条件性视角研究VLA模型,实证发现成功轨迹始终比失败轨迹具有更强的视觉依赖。基于此,提出一种训练框架:先在追踪类代理任务上通过偏好优化对齐动作预测与视觉输入,再通过监督微调中的隐空间蒸馏将增强的对齐能力迁移到指令跟随任务。该方法不改变模型结构,也不需额外数据采集,在离散型OpenVLA上提升视觉条件性与任务性能,并在连续型OpenVLA-OFT设置中持续获得增益。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce vision-action misalignment, where action predictions exhibit weak dependence on the current visual state, leading to unreliable action outputs. In this work, we study VLA models through the lens of visual conditioning and empirically show that successful rollouts consistently exhibit stronger visual dependence than failed ones. Motivated by this observation, we propose a training framework that explicitly strengthens visual conditioning in VLA models. Our approach first aligns action prediction with visual input via preference optimization on a track-following surrogate task, and then transfers the enhanced alignment to instruction-following task through latent-space distillation during supervised finetuning. Without introducing architectural modifications or additional data collection, our method improves both visual conditioning and task performance for discrete OpenVLA, and further yields consistent gains when extended to the continuous OpenVLA-OFT setting. Project website: https://vista-vla.github.io/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。