arXiv:2509.23224cs.ROcs.AI2025-09被引 39

让视觉语言动作模型实时纠正动作块,提升反应速度与长期稳定性。

Leave No Observation Behind: Real-time Correction for VLA Action Chunks

  • 引入轻量级实时校正头,每控制步更新动作修正。
  • 在动态任务中延迟增加时成功率提升23%,长周期下仍保持鲁棒性。
  • 无需重训练,可直接接入现有模型,适合实时控制场景。

为提升效率和时间连贯性,视觉-语言-动作(VLA)模型常采用动作块预测;但此举会削弱推理延迟和长时程下的反应能力。本文提出异步动作块校正(A2C2),一种轻量级实时校正头,每控制步运行一次,对任意现成VLA的动作块添加时间感知修正。该模块结合最新观测、VLA预测动作(基动作)、动作在块中的位置编码及部分基策略特征,输出每步修正值。该方法不改变基模型能力,恢复闭环响应性。无需重训练,且与异步执行方案(如RTC)兼容。在动态Kinetix任务集(12项任务)和LIBERO Spatial上,相比RTC,分别实现成功率提升23个百分点和7个百分点,即使无注入延迟也显著增强长时程鲁棒性。校正头计算开销极小,对大型VLA推理影响可忽略。结果表明A2C2是部署高容量分块策略于实时控制的有效即插即用机制。

原文摘要 · Abstract (English)

To improve efficiency and temporal coherence, Vision-Language-Action (VLA) models often predict action chunks; however, this action chunking harms reactivity under inference delay and long horizons. We introduce Asynchronous Action Chunk Correction (A2C2), which is a lightweight real-time chunk correction head that runs every control step and adds a time-aware correction to any off-the-shelf VLA's action chunk. The module combines the latest observation, the predicted action from VLA (base action), a positional feature that encodes the index of the base action within the chunk, and some features from the base policy, then outputs a per-step correction. This preserves the base model's competence while restoring closed-loop responsiveness. The approach requires no retraining of the base policy and is orthogonal to asynchronous execution schemes such as Real Time Chunking (RTC). On the dynamic Kinetix task suite (12 tasks) and LIBERO Spatial, our method yields consistent success rate improvements across increasing delays and execution horizons (+23% point and +7% point respectively, compared to RTC), and also improves robustness for long horizons even with zero injected delay. Since the correction head is small and fast, there is minimal overhead compared to the inference of large VLA models. These results indicate that A2C2 is an effective, plug-in mechanism for deploying high-capacity chunking policies in real-time control.

实时控制动作块校正VLA模型闭环响应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。