arXiv:2605.08168cs.ROcs.AI2026-05被引 3

对比四种异步推理方法,找出最抗延迟的机器人控制策略。

Understanding Asynchronous Inference Methods for Vision-Language-Action Models

  • 统一代码库在多个数据集上系统比较四类异步推理方法。
  • A2C2在延迟达8步时仍保持90%以上成功率,表现最佳。
  • TT-RTC无推理开销且鲁棒性强,适合实际部署场景。

视觉-语言-动作(VLA)模型为通用机器人控制提供了前景,但其推理延迟导致动作执行时观测过时。现有方法包括推理时补全(IT-RTC)、训练时延迟模拟(TT-RTC)、未来状态感知条件化(VLASH)和轻量级残差修正(A2C2),各自采用不同思路,但此前评估条件不一。本文在统一代码库下,使用MLPMixer策略在Kinetix上、SmolVLA在LIBERO上,对四种方法进行系统对比,测试最大推理延迟达20个控制步。结果表明:A2C2在延迟达8步时仍保持超90%求解率,是Kinetix上最有效方法;在LIBERO上从延迟4步起领先。IT-RTC在低延迟下表现尚可,但在长间隔(H=30)和高延迟下性能骤降。TT-RTC作为训练基方法最稳健,对最大延迟设置不敏感,泛化能力好,且推理无额外开销。VLASH存在低延迟与高延迟间的明显权衡,受微调延迟范围[0, d_max]影响显著。代码已开源。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models offer a promising path to generalist robot control, but their inference latency causes observation staleness when generated actions are executed asynchronously. Several methods have been proposed concurrently to mitigate this problem: inference-time inpainting (IT-RTC), training-time delay simulation (TT-RTC), future-state-aware conditioning (VLASH), and lightweight residual correction (A2C2). Each takes a fundamentally different approach, but they have so far been evaluated independently with different codebases, base policies, and protocols. We present a systematic comparison of these four methods under controlled conditions. We develop two unified codebases that integrate all methods with harmonized library and dataset versions, and we benchmark them on the Kinetix suite with MLPMixer policies and on the LIBERO manipulation benchmark with SmolVLA, sweeping inference delays up to $d=20$ control steps. A2C2's per-step residual correction is the most effective method on Kinetix, holding above 90% solve rate up to $d=8$, and also leads on LIBERO from $d=4$ onwards. IT-RTC is competitive at low delays but degrades sharply under long chunks ($H=30$) and high delays. TT-RTC is the most robust training-based method: stable across $d_\max$ choices, generalizes beyond its training delay distribution, and adds zero inference overhead. VLASH exhibits a clear low-delay vs. high-delay trade-off governed by the fine-tuning delay range $[0,d_\max]$. Code is available at https://github.com/TheAyos/async-vla-inference

机器人控制异步推理VLA模型延迟容忍

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。