arXiv:2608.24882cs.RO2026-08

用压缩的隐动作表示意图,让机器人模型高效预判未来动作。

Latent Action as Intention Enables Efficient Future Imagination for World Action Models

论文配图:Latent Action as Intention Enables Efficient Future Imagination for World Action Models
图 1 · 摘自论文原文
  • 用离散隐动作编码未来意图,省去生成未来画面的耗时步骤。
  • 在少量演示下仍达65.6%成功率,比基线快42.9%推理速度。
  • 适合需要快速响应又要求泛化能力的机器人控制任务。

世界动作模型(WAMs)通过建模观测变化来提升机器人控制,但测试时生成未来观测会带来显著延迟。Fast-WAM为提高效率移除了该过程;然而我们匹配实现发现其泛化能力较差,尤其在示范数据稀缺和分布外场景中。为此,我们提出LAWA,一种使用紧凑隐动作作为未来意图操作表示的WAM架构,实现高效测试时未来想象而无需生成未来观测。具体地,通过无动作预训练增强的离散分词器生成以操作为中心的代码本目标。LAWA联合去噪一个锚定于这些目标的连续隐状态,并使用可执行的动作块,推理时省略未来视频分支。在RoboCasa上,LAWA在少样本和全数据设置下分别达到65.6%和80.8%的平均成功率,较匹配的Fast-WAM基线分别提升9.6和4.5个百分点。同时保持与匹配的Joint-WAM相当的性能水平,但推理延迟降低42.9%。LAWA在LIBERO-Plus上展现良好零样本鲁棒性,在真实任务中表现优异。结果表明,未来想象不必舍弃:通过紧凑隐动作保留它,可在性能、泛化与延迟间取得有效平衡。代码与模型将公开。

原文摘要 · Abstract (English)

World action models (WAMs) improve robot control by modeling how observations evolve, but generating future observations at test time incurs substantial latency. Fast-WAM removes this process for efficiency; however, our matched implementations show lower generalization for Fast-WAM than for future-aware alternatives, especially with scarce robot demonstrations and in out-of-distribution scenarios. To bridge this gap, we introduce **LAWA**, a WAM architecture that uses compact latent actions as an operational representation of future intentions, enabling efficient test-time future imagination without generating future observations. Specifically, a discrete tokenizer enhanced by action-free pre-training produces manipulation-centric codebook targets. LAWA jointly denoises a continuous latent state anchored to these targets with executable action chunks while omitting the future-video branch at inference. On RoboCasa, LAWA achieves state-of-the-art average success rates of 65.6% and 80.8% in the few-shot and full data settings, improving over the matched Fast-WAM baseline by 9.6 and 4.5 points, respectively. It also preserves the performance level of the matched Joint-WAM variant while requiring 42.9% lower inference latency. LAWA also demonstrates competitive zero-shot robustness on LIBERO-Plus and superior performance on real-world tasks. These results show that future imagination need not be discarded: retaining it with compact latent actions yields an effective trade-off among performance, generalization, and latency. Code and models will be released.

机器人控制隐动作高效推理未来预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。