arXiv:2606.18589cs.RO2026-06被引 1

让机器人动作块执行更稳健,通过预测未来状态动态选最优动作。

DREAM-Chunk: Reactive Action Chunking with Latent World Model

论文配图:DREAM-Chunk: Reactive Action Chunking with Latent World Model
图 1 · 摘自论文原文
  • 用轻量潜空间模型预测动作块的多种可能未来状态
  • 测试时多采样候选动作块,选最匹配实际观察的执行
  • 无需微调模型,对含纠正行为的演示更有效

动作块已成为视觉-语言-动作模型的通用接口,支持低频策略推理驱动高频机器人执行。然而,一旦动作块被执行,其开环行为在随机动力学、硬件误差和部分可观测条件下容易失效。我们提出 DREAM-Chunk,一种测试时扩展方法,在不需额外策略微调的前提下,为基于动作块的策略引入轻量级潜空间世界模型。测试时,DREAM-Chunk 对多个候选动作块进行采样,滚动预测其潜空间未来状态,并选择预测状态与实际观测最匹配的动作块。该方法利用额外测试计算覆盖多种可能的随机未来,提升长周期动作块执行中的反应能力。在 Kinetix 基准上,DREAM-Chunk 在增加动作噪声下提升了鲁棒性,且在更大候选样本量下表现更优,尤其当示范中包含修正行为时。我们在两个机器人平台和两种 VLA 策略上验证了 DREAM-Chunk 在四种操作任务中的有效性,涵盖模拟与硬件实验,结果表明其显著提升了动作块策略在随机动力学下的鲁棒性。

原文摘要 · Abstract (English)

Action chunking has become a common interface for vision-language-action (VLA) models, enabling low-frequency policy inference to drive high-frequency robot execution. However, once an action chunk is committed, its open-loop execution can be brittle under stochastic dynamics, hardware execution errors, and partial observability. We propose DREAM-Chunk, a test-time scaling method that augments chunking-based policies with a lightweight latent world model, without requiring additional policy fine-tuning. At test time, DREAM-Chunk samples multiple candidate action chunks, rolls out their predicted latent futures, and selects actions from the chunk whose predicted state best matches the observed rollout. In this way, DREAM-Chunk uses additional test-time computation to cover multiple plausible stochastic futures and improve reactivity during long-horizon chunk execution. On the Kinetix benchmark, DREAM-Chunk improves robustness under increasing action noise and benefits from larger candidate sample sizes, especially when demonstrations contain corrective behaviors. We further validate DREAM-Chunk on four manipulation tasks across two robot platforms and two VLA policies under various sources of stochasticity. Across simulation and hardware experiments, DREAM-Chunk improves the robustness of action-chunking policies in stochastic dynamics.

动作块机器人世界模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。