arXiv:2607.29235cs.ROcs.AI2026-07

提出无需训练的异步反馈机制,实时修正机器人长时序动作预测误差。

FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution

论文配图:FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution
图 1 · 摘自论文原文
  • 在生成过程中嵌入异步反馈,用真实观测修正下一帧预测
  • 在多个任务上提升成功率超5%,显著改善真实机器人跟踪效果
  • 无需额外训练,适合对实时性要求高的长时序控制场景

尽管世界-动作模型(WAMs)通过预测视觉演变来增强长时序机器人控制,但其可靠性依赖于在真实观测中反复重新定位——而非递归推演。现有方法通过在块间刷新历史或键值缓存来实现重定位,但这种粗粒度的时间反馈无法在单步层面纠正预测误差。为此,我们提出无训练的反馈流匹配(FBFM)机制,将重定位嵌入到主动生成的块内部。在流匹配过程中,FBFM对条件速度场施加掩码伪逆修正:利用前一动作块引导下一动作块生成,并使用执行该块后观察到的图像指导下一帧预测。这种跨块配对机制使反馈能及时影响后续生成,形成异步闭环,从而在不等待块边界的情况下纠正误差。由于无需训练,该机制提升了对突发事件的响应能力,抑制了长时序任务中的漂移现象。我们在联合生成式WAM(DreamZero)和分阶段式WAM(LingBot-VA)上进行了评估,在部分LIBERO和RoboTwin2.0任务中,成功率提升超过5%;真实机器人观测-预测诊断显示跟踪性能明显改善。我们认为FBFM为细粒度在线校正提供了一种新范式,弥合了开环流生成与闭环比对真实动态之间的鸿沟。

原文摘要 · Abstract (English)

Although world-action models (WAMs) enhance long-horizon robot control by predicting visual evolution before acting, long-horizon reliability demands repeated re-grounding in real observations--not recursive rollout. Existing WAMs address this by refreshing history or KV cache with ground-truth data between chunks. However, such chunk-wise feedback operates at a coarse temporal granularity and thus fails to correct prediction errors at the individual time-step level. To address this, we propose Feedback Flow Matching (FBFM), a training-free inference mechanism that pushes re-grounding inside the actively generated chunk. During flow matching, FBFM applies a masked pseudoinverse correction to the conditional velocity field: it leverages the preceding action chunk to guide generation of the next action chunk, and uses the image observed after executing that preceding chunk to guide the next frame prediction. This cross-chunk pairing--where feedback from one chunk arrives in time to shape the next--creates an asynchronous loop that corrects errors without waiting for chunk boundaries. Being training-free, the mechanism improves responsiveness to unexpected events and suppresses drift in long-horizon tasks. We evaluate FBFM on both a joint-generation WAM (DreamZero) and a stage-wise WAM (LingBot-VA). On selected LIBERO and RoboTwin2.0 tasks, it improves success rates by over 5% in favorable settings, and real-world robot observation-prediction diagnostics show notably better tracking. We argue that FBFM offers a new paradigm for fine-grained online correction, bridging open-loop flow generation with closed-loop real-world dynamics.

机器人控制流匹配在线修正异步反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。