arXiv:2605.19294cs.ROcs.AI2026-05

让视觉语言动作模型适应延迟,提升异步执行下的任务成功率。

DEFLECT: Temporal Counterfactual Preference Learning for Delay-Robust Asynchronous VLAs

论文配图:DEFLECT: Temporal Counterfactual Preference Learning for Delay-Robust Asynchronous VLAs
图 1 · 摘自论文原文
  • 用未来观测生成理想动作,对比旧观测下的错误动作,训练模型选对时机的动作。
  • 在真实机器人任务中,长延迟下成功率提升4.6个百分点,最高达6.4点提升。
  • 无需人类标注或额外计算,可直接部署到现有异步视觉语言动作模型。

视觉语言动作(VLA)策略越来越多地采用异步推理以隐藏大模型延迟,使其在机器人运动过程中并行处理。然而,这导致预测与执行时间不一致:下一动作基于推理开始时的过时观测生成,但实际执行时场景已变化,造成动作与当前状态错位。现有方法未直接解决这一时序失配问题。本文提出 DEFLECT,一种离线后训练框架,将延迟引起的失配转化为反事实偏好监督:冻结的参考VLA从未来执行时刻的观测生成优选动作,从旧预测时刻的观测生成次优动作。训练中的策略在相同部署输入下评估两者,学习优先选择与执行时刻匹配的动作,同时通过监督微调保持专家动作流形。DEFLECT 不需要人工偏好标签、奖励模型、在线机器人回放、架构修改或额外推理计算。在 Kinetix、LIBERO 及三个真实机器人任务上,相比强基线,显著提升延迟鲁棒性,高延迟成功率最高提升6.4个百分点,在真实规模VLA上最长延迟下仍取得4.6个百分点提升。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) policies increasingly rely on asynchronous inference to hide large-model latency behind ongoing robot motion. While this avoids the stop-and-go behavior of synchronous action-chunk execution, it creates a prediction-execution mismatch: the next chunk is computed from a stale observation at inference start but executed only after the robot and scene have evolved. As a result, actions that fit the prediction-time state can become misaligned with the execution-time state. Existing runtime repair, behavior-cloning, and preference-alignment approaches do not directly teach the policy to resolve this stale-input mismatch. We propose DEFLECT, an offline post-training framework for delay-robust asynchronous VLAs. DEFLECT converts latency-induced mismatch into counterfactual preference supervision: a frozen reference VLA generates a preferred chunk from the future execution-time observation and a rejected chunk from the stale prediction-time observation. The trainable policy scores both chunks under the same deployment-time input, learning to favor execution-time-aligned actions while a supervised fine-tuning anchor preserves the expert action manifold. DEFLECT requires no human preference labels, reward models, online robot rollouts, architectural changes, or additional inference-time computation. Across Kinetix, LIBERO, and three real-robot tasks, DEFLECT improves delay robustness over strong asynchronous VLA baselines, raising high-latency success by up to 6.4 percentage points and achieving a 4.6 percentage-point gain at the longest delay on a real-scale VLA.

视觉语言动作延迟鲁棒异步执行反事实学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。