arXiv:2412.04987cs.RO2024-12被引 135

用一致性流匹配实现3D机器人操作的快速高效策略生成

FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulation

  • 通过归一化速度场自一致性,实现单步推理生成策略
  • 在Adroit和Metaworld上推理速度提升7倍,成功率保持领先
  • 适合需要实时响应的机器人抓取与复杂操作任务

机器人可通过从专家示范中学习策略来掌握复杂操作技能,这通常称为基于视觉的模仿学习。基于扩散和流匹配的模型已被证明在机器人操作任务中有效。然而,递归式方法在从噪声分布到策略分布的推断过程中效率低下,导致效率与质量之间的权衡。为此,我们提出FlowPolicy,一种基于一致性流匹配与3D视觉的快速策略生成新框架。该方法通过归一化速度场的自一致性来优化流动力学,使模型能在单次推理中直接生成任务执行策略。具体而言,FlowPolicy以观测的3D点云为条件,利用一致性流匹配直接定义不同时间状态到同一动作空间的直线流,同时约束其速度值——即通过归一化动作空间内的速度场自一致性,近似从噪声到机器人动作的轨迹,从而提升推断效率。我们在Adroit和Metaworld上验证了FlowPolicy的有效性,结果显示推理速度提升7倍,且平均成功率与当前最优方法相当。代码已公开于https://github.com/zql-kk/FlowPolicy。

原文摘要 · Abstract (English)

Robots can acquire complex manipulation skills by learning policies from expert demonstrations, which is often known as vision-based imitation learning. Generating policies based on diffusion and flow matching models has been shown to be effective, particularly in robotic manipulation tasks. However, recursion-based approaches are inference inefficient in working from noise distributions to policy distributions, posing a challenging trade-off between efficiency and quality. This motivates us to propose FlowPolicy, a novel framework for fast policy generation based on consistency flow matching and 3D vision. Our approach refines the flow dynamics by normalizing the self-consistency of the velocity field, enabling the model to derive task execution policies in a single inference step. Specifically, FlowPolicy conditions on the observed 3D point cloud, where consistency flow matching directly defines straight-line flows from different time states to the same action space, while simultaneously constraining their velocity values, that is, we approximate the trajectories from noise to robot actions by normalizing the self-consistency of the velocity field within the action space, thus improving the inference efficiency. We validate the effectiveness of FlowPolicy in Adroit and Metaworld, demonstrating a 7$\times$ increase in inference speed while maintaining competitive average success rates compared to state-of-the-art methods. Code is available at https://github.com/zql-kk/FlowPolicy.

机器人操控流匹配3D视觉策略生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。