通过逆动力学学习,让视觉语言动作模型更区分相似状态,提升机器人控制精度。
Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning

- 用逆动力学预测动作,直接训练视觉编码器区分细微视觉差异。
- 在CALVIN和SimplerEnv上提升多款基线模型性能,减少状态混淆。
- 无需额外标注,兼容现有框架,适合低级机器人控制场景。
视觉-语言-动作(VLA)模型通过将预训练的视觉语言模型适配到动作预测,统一了机器人的感知、推理与控制。然而,源自视觉语言模型的表征对低层控制所需的细微视觉差异不敏感,导致视觉相似状态间存在状态混淆,需执行完全不同动作。以往研究通过生成未来帧、2D定位点或中间推理步骤等目标间接改善视觉理解,但未显式分析特征空间中的状态混淆问题。为此,本文引入逆动力学学习作为辅助目标,直接监督VLA的视觉编码器。通过预测当前与未来观测之间的动作,该目标促使编码器捕捉决定低层动作的细粒度视觉差异。进一步采用伪反向监督,使编码器接触更广泛的动作方向,提升有限示范下的泛化能力。方法适用于多种VLA基线,仅使用标准观测-动作对,无需额外标注,测试时保持原有推理流程。在CALVIN ABC-D和SimplerEnv上的实验表明,该方法在多个基线中实现稳定提升。冻结编码器探查与状态特征对齐分析显示,所学表征具有状态区分性,有效降低状态混淆,并更好匹配机器人状态变化。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have emerged as a promising framework that unifies perception, reasoning, and control for robot manipulation by adapting pretrained vision-language models (VLMs) to action prediction. However, VLM-derived representations are often insensitive to subtle visual distinctions required for low-level control, causing state aliasing between visually similar states that require substantially different actions. Prior VLA studies improve visual understanding by generating visual or reasoning outputs, such as future frames, 2D grounding points or traces, or intermediate spatial reasoning steps, but these objectives typically shape the vision encoder only indirectly through end-to-end prediction and do not explicitly analyze state aliasing in the learned visual feature space. To mitigate state aliasing, we introduce inverse dynamics learning as an auxiliary objective that directly supervises the VLA vision encoder. By predicting the action between current and future observations, our objective encourages the encoder to capture fine-grained visual distinctions that determine low-level actions. We further use pseudo-reversed supervision to expose the encoder to a broader range of action directions and improve generalization under limited robot demonstrations. Our method applies to diverse VLA baselines, uses only standard observation-action pairs without additional annotations, and preserves the original inference pipeline at test time. Experiments on CALVIN ABC-D and SimplerEnv show consistent gains across diverse VLA baselines. Frozen-encoder probing and state-feature alignment analyses further show that our method learns state-discriminative visual representations that reduce state aliasing and better align with robot state changes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。