arXiv:2604.14732cs.ROcs.LG2026-04被引 7

让视觉语言动作模型隐式规划,提升长程任务决策能力。

World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems

论文配图:World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems
图 1 · 摘自论文原文
  • 用潜在空间隐式推演未来轨迹,不直接优化路径
  • 在长程任务中成功率显著提升,优于现有方法
  • 适合需要复杂推理与泛化能力的智能体系统

视觉-语言-动作(VLA)模型是构建具身智能体的新兴范式,能将感知与语言转化为行动。但多数方法依赖直接动作预测,缺乏对长程轨迹的推理与后果评估能力,限制了其在复杂决策任务中的表现。本文提出世界-价值-动作(WAV)模型,一种统一框架,实现VLA系统的隐式规划。WAV不进行显式轨迹优化,而是学习基于视觉观测和语言指令的未来轨迹结构化潜在表示。一个预训练的世界模型预测未来状态,轨迹价值函数评估其长期效用。动作生成被形式化为该潜在空间中的推理过程,模型逐步将概率质量集中于高价值且动态可行的轨迹上。理论分析表明,直接在动作空间规划会因轨迹可行性随时间指数衰减而失效;而潜在空间推理能重塑搜索分布,聚焦可行区域,实现高效长程决策。大量仿真与真实世界实验表明,WAV模型持续优于当前最优方法,在任务成功率、泛化能力与鲁棒性方面均有显著提升,尤其在长程及组合型场景中表现突出。代码已开源:https://github.com/Win-commit/WAV。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have emerged as a promising paradigm for building embodied agents that ground perception and language into action. However, most existing approaches rely on direct action prediction, lacking the ability to reason over long-horizon trajectories and evaluate their consequences, which limits performance in complex decision-making tasks. In this work, we introduce World-Value-Action (WAV) model, a unified framework that enables implicit planning in VLA systems. Rather than performing explicit trajectory optimization, WAV model learn a structured latent representation of future trajectories conditioned on visual observations and language instructions. A learned world model predicts future states, while a trajectory value function evaluates their long-horizon utility. Action generation is then formulated as inference in this latent space, where the model progressively concentrates probability mass on high-value and dynamically feasible trajectories. We provide a theoretical perspective showing that planning directly in action space suffers from an exponential decay in the probability of feasible trajectories as the horizon increases. In contrast, latent-space inference reshapes the search distribution toward feasible regions, enabling efficient long-horizon decision making. Extensive simulations and real-world experiments demonstrate that the WAV model consistently outperforms state-of-the-art methods, achieving significant improvements in task success rate, generalization ability, and robustness, especially in long-horizon and compositional scenarios. Code is available at https://github.com/Win-commit/WAV.

视觉语言动作隐式规划具身智能体长程决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。