提出新方法让机器人动作更准更快,避免错误累积。
SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment
- 用专家示范选择性修正动作,保持视觉与动作一致
- 实测比顶尖方法准确率更高,推理延迟降低98%以上
- 适合需要实时响应的机器人操作任务
开发高效且准确的视觉-运动策略是机器人模仿学习的核心挑战。尽管近期修正流方法已推动视觉-运动策略学习进展,但存在关键缺陷:经过多轮精炼后,生成的动作可能偏离当前视觉观测对应的真实动作,导致重复重流时误差累积,任务执行不稳定。本文提出选择性流对齐(SeFA),一种高效且准确的视觉-运动策略学习框架。SeFA通过选择性流对齐策略,利用专家示范有选择地修正生成动作,恢复动作与观测的一致性,同时保持多模态特性。该设计引入一致性修正机制,确保生成动作始终与观测对齐,且不牺牲单步流推断的效率。在模拟和真实世界操作任务上的大量实验表明,SeFA策略超越当前最先进的基于扩散和基于流的策略,在准确性与鲁棒性上表现更优,同时将推理延迟降低超过98%。通过统一修正流的效率与观测一致的动作生成,SeFA为实时视觉-运动策略学习提供了可扩展、可靠的解决方案。代码开源于 https://github.com/RongXueZoe/SeFA。
原文摘要 · Abstract (English)
Developing efficient and accurate visuomotor policies poses a central challenge in robotic imitation learning. While recent rectified flow approaches have advanced visuomotor policy learning, they suffer from a key limitation: After iterative distillation, generated actions may deviate from the ground-truth actions corresponding to the current visual observation, leading to accumulated error as the reflow process repeats and unstable task execution. We present Selective Flow Alignment (SeFA), an efficient and accurate visuomotor policy learning framework. SeFA resolves this challenge by a selective flow alignment strategy, which leverages expert demonstrations to selectively correct generated actions and restore consistency with observations, while preserving multimodality. This design introduces a consistency correction mechanism that ensures generated actions remain observation-aligned without sacrificing the efficiency of one-step flow inference. Extensive experiments across both simulated and real-world manipulation tasks show that SeFA Policy surpasses state-of-the-art diffusion-based and flow-based policies, achieving superior accuracy and robustness while reducing inference latency by over 98%. By unifying rectified flow efficiency with observation-consistent action generation, SeFA provides a scalable and dependable solution for real-time visuomotor policy learning. Code is available on https://github.com/RongXueZoe/SeFA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。