arXiv:2605.06481cs.RO2026-05被引 19

提出可定位物体的机器人动作模型,提升复杂场景下的操作鲁棒性。

OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation

论文配图:OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation
图 1 · 摘自论文原文
  • 将场景分解为带地址的物体槽,实现对特定物体的精准操作
  • 在LIBERO数据集上达97.8%成功率,几何轴任务表现领先
  • 适合需要高精度物体交互的机器人系统开发

世界动作模型(WAM)通过联合预测场景演化与机器人动作来增强视觉-语言-动作策略,但现有方法通常将世界状态表示为整体图像、视频标记或全局隐变量。这类表示在指令指向特定物体时难以精确定位,尤其在场景变化下物体身份与上下文纠缠。本文提出OA-WAM:一种面向鲁棒机器人操作的可定位物体世界动作模型。该模型将每帧分解为N+1个槽状态,包含1个机器人槽和N个物体槽,每个槽包含持久的地址向量与随时间变化的内容向量,并在块因果序列中融合文本、图像、本体感知和历史动作标记。世界头预测下一帧槽状态,而流匹配动作头在同一前向传播中解码16步连续动作块。通过仅用地址作为注意力键并每层重置地址部分,强制实现可定位性,将‘作用于哪个物体’与‘该物体当前状态’分离,无需额外标记。OA-WAM在LIBERO(97.8%)、SimplerEnv(79.3%)上达到强基线水平,在最相关的LIBERO-Plus几何轴任务上达到当前最优性能,七轴综合任务仍具竞争力。因果槽干预测试显示交换绑定余弦达0.87,而整体基线最高仅0.09。结果表明,可定位物体状态为应对场景扰动的世界-动作建模提供了有效接口。

原文摘要 · Abstract (English)

World Action Models (WAMs) enhance Vision-Language-Action policies by jointly predicting scene evolution and robot actions, but existing methods usually represent the predicted world as holistic images, video tokens, or global latents. These representations are difficult for an action decoder to address when an instruction refers to a particular object, especially under scene shifts where object identity is entangled with context. We propose OA-WAM, an Object-Addressable World Action Model for robust robot manipulation. OA-WAM decomposes each frame into N+1 slot states, with one robot slot and N object slots. Each slot contains a persistent address vector and a time-varying content vector, and is fused with text, image, proprioception, and past-action tokens in a block-causal sequence. A world head predicts next-frame slot states, while a flow-matching action head decodes a 16-step continuous action chunk in the same forward pass. Addressability is enforced by routing cross-slot attention through address-only keys and resetting the address slice at every transformer layer, separating which object to act on from what that object currently is without adding extra tokens. OA-WAM matches strong VLA and WAM baselines on LIBERO (97.8%) and SimplerEnv (79.3%), reaches state-of-the-art performance on the most relevant LIBERO-Plus geometric axes, and remains competitive on the seven-axis aggregate. A causal slot-intervention test yields a swap-binding cosine of 0.87, versus at most 0.09 for holistic baselines. These results suggest that addressable object states provide an effective interface for robust world-action modeling under scene perturbations.

机器人操作动作建模可定位性多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。