通过调整分词范围与约束解码,实现自回归策略的实时执行。
Real-Time Execution with Autoregressive Policies

- 调整令牌化窗口并使用约束解码,实现低延迟推理。
- 在仿真与真实环境中均比流匹配策略更快完成任务。
- 适合需要快速响应和高泛化能力的复杂指令执行场景。
实时执行依赖于异步推理以保证动作轨迹平滑且响应迅速,对大规模视觉-语言-动作模型的实际部署至关重要。尽管现有研究多聚焦于扩散策略的实时性优化,但自回归策略在同步推理下速度更慢,其实时执行需求更为迫切。本文表明,通过调整分词时域并应用约束解码,自回归策略可实现严格延迟保障,并支持多轨迹解码以提升性能。在仿真与真实环境测试中,该策略始终优于同级别流匹配策略,任务完成速度显著快于同步推理基准。结合自回归策略在指令遵循中收敛更快、泛化能力更强的优势,证明其仍具备支撑实时执行的竞争力。
原文摘要 · Abstract (English)
Real-time execution, enabled by asynchronous inference that ensures both smooth action trajectories and fast reactivity, is critical for realistic deployments of large-scale Vision-Language-Action models. However, recent work on real-time execution primarily focuses on variants of diffusion policies, even though it is more critical for autoregressive policies given their slower rollout speed in synchronous inference. In contrast, we demonstrate that autoregressive policies can achieve real-time execution by adjusting the tokenization horizon and applying constrained decoding, thereby guaranteeing strict latency bounds that enable multi-trajectory decoding to maximize performance. Across simulated and real-world environments, we find that the autoregressive policy consistently outperforms its equivalent-level flow-matching policy counterpart while achieving significantly improved task completion speeds from synchronous inference. Coupled with the inherent advantages of autoregressive policies, such as faster convergence and better generalizability in instruction-following, these results confirm that autoregressive policies can remain a competitive policy type supporting real-time execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。