arXiv:2605.21862cs.ROcs.AI2026-05被引 2

让机器人在分段执行任务时持续更新对环境的感知,提升控制准确性。

EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control

论文配图:EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control
图 1 · 摘自论文原文
  • 用循环场景前缀保存动作影响后的环境状态,跨步骤传递。
  • 在31个任务上成功率从87.2%提升至89.1%,真实机器人上表现最优。
  • 适合需要长程规划与物理交互的机器人控制场景。

分段式视觉-语言-动作(VLA)策略在每一步仅依赖当前视觉观测预测多步控制。然而,机器人动作会引发接触、遮挡和物体运动,导致后续决策依赖的几何结构在下一次视觉更新前已变化。现有空间型VLA仅关注当前帧几何,时序型VLA仅聚合历史帧信息,均无法在分段间保持动作更新后的场景先验。本文提出EvoScene-VLA,其递归场景前缀在控制调用间持续维护一个几何感知的场景状态。每次调用视觉-语言模型(VLM)时,模型融合当前观测与上一阶段的动作更新先验;动作解码器输出下一步动作块及紧凑的场景更新,该更新成为下一阶段的先验,在下次调用时由新观测校正。训练中使用“场景预测器”提供未来场景标记目标,以及“几何锚定”对齐场景槽与冻结的深度和3D教师模型。部署时丢弃这两模块。在31个RoboTwin任务中,固定评估成功率从87.2%提升至89.1%,随机评估从86.1%提升至88.5%。在Galaxea R1-Lite真实机器人上,EvoScene-VLA优于所有基线。

原文摘要 · Abstract (English)

Chunked vision-language-action (VLA) policies predict multi-step robot controls, conditioning each update on the current visual observation alone. Yet robot actions cause contact, occlusion, and object motion, and the geometry that later decisions depend on can change before the next visual update arrives. Spatial VLAs improve current-frame geometry. Temporal VLAs aggregate past frames. Neither maintains an action-updated scene prior across chunks. We argue for a persistent action-updated scene state across control calls, and introduce EvoScene-VLA. Its recurrent scene prefix carries a geometry-aware scene state across chunks. At each vision-language model (VLM) call, the VLM combines scene information from the current observation with the action-updated prior from the previous chunk; the action decoder outputs both the next action chunk and a compact scene update. This update becomes the next prior, which the VLM corrects against the new observation when the next call arrives. Each control call therefore starts from a scene prior that reflects both recent actions and fresh visual evidence. During training, \textbf{Scene Predictor} supplies future scene-token targets, and Geometric Anchor aligns scene slots with frozen depth and 3D teachers. We discard both modules at deployment. On 31 RoboTwin tasks, EvoScene-VLA raises average success from 87.2% to 89.1% in fixed evaluation and from 86.1% to 88.5% in randomized evaluation. On the Galaxea R1-Lite real robot, EvoScene-VLA outperforms all baselines.

机器人控制场景建模视觉-语言分段策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。