arXiv:2608.01880cs.RO2026-08被引 1

解决机器人执行中动作模型延迟导致的卡顿问题,实现流畅实时控制。

World Action Models in Real Time: An Empirical Study of Smooth Execution via Asynchronous Deployment

  • 采用异步部署策略,让模型推理与动作执行并行进行。
  • 前缀条件生成法在速度、平滑度和任务表现上综合最优。
  • 时间对齐是消除动作断点的关键,单纯拼接无法修复误差。

世界动作模型通过迭代去噪生成固定时长的动作块,带来显著推理延迟,导致机器人执行时出现停顿、过时动作和不连贯现象。本文针对10 Hz双臂机器人平台,实证比较了六种异步部署策略:同步执行、纯异步切换、事后动作融合、去噪时间融合、推理时速度引导及前缀条件生成。评估结合离线轨迹分析与在线实验,涵盖动态操作、高精度放置和长时程任务。结果表明,观测、预测与执行命令之间的精确时间对齐是根本要求;对齐误差会导致持续的块边界断点,仅靠融合无法修复。正确对齐下,直接加权动作虽简单平滑,但在高精度任务中牺牲准确性;推理时速度引导无法可靠约束已承诺动作。相比之下,前缀条件生成在训练中学习一致动作延续,在任务性能、执行速度与轨迹平滑性间取得最佳平衡。研究厘清了异步部署策略的实用权衡,为高延迟世界动作模型在实时机器人系统中的部署提供指导。

原文摘要 · Abstract (English)

World Action Models generate fixed-horizon action chunks through iterative denoising, creating substantial inference latency that can cause pauses, stale actions, and discontinuities during robotic execution. We present an empirical study of asynchronous deployment strategies that overlap model inference with action execution to enable responsive and smooth control. We compare six strategies, including synchronous execution, pure asynchronous switching, post-hoc action blending, denoising-time blending, inference-time velocity guidance, and prefix-conditioned generation, on a 10 Hz bimanual robot. Evaluation combines offline trajectory analysis with online experiments across dynamic manipulation, precision-critical placement, and long-horizon tasks. Our results identify accurate temporal alignment between observations, predictions, and executed commands as a fundamental requirement. Alignment errors produce persistent chunk-boundary discontinuities that cannot be corrected through blending alone. With proper alignment, direct action weighting provides a simple and smooth baseline but sacrifices accuracy in precision-critical tasks. Inference-time velocity guidance fails to reliably constrain committed actions on our platform. In contrast, prefix-conditioned generation achieves the best overall balance between task performance, execution speed, and trajectory smoothness by learning consistent action continuations during training. These findings clarify the practical trade-offs among asynchronous deployment strategies and provide guidance for deploying high-latency World Action Models in real-time robotic systems.

机器人控制动作生成异步部署实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。