arXiv:2605.08511cs.RO2026-05

提出轨迹一致的流匹配方法,让机器人抓取更稳定可靠。

Trajectory-Consistent Flow Matching for Robust Visuomotor Policy Learning

论文配图:Trajectory-Consistent Flow Matching for Robust Visuomotor Policy Learning
图 1 · 摘自论文原文
  • 用轨迹一致性监督替代点式速度训练,缩小训练与推理差距
  • 在真实机器人上实现70%和60%成功率,远超零分的基线方法
  • 适合长时序、多阶段的复杂机器人操作任务

流匹配策略通过学习连续速度场将噪声映射为动作,实现机器人操作的快速确定性推理。然而,标准训练优化的是逐点速度目标,而推理需对速度场进行数值积分,这种不匹配导致轨迹误差累积。本文提出四种互补改进:(1) 辅助修正流速度回归,在整个时间区间提供均匀的时间监督;(2) 多步轨迹一致性训练,直接监督速度场在轨迹片段上的积分位移,填补训练-推理鸿沟;(3) 速度场正则化,强化时间平滑性,防止振荡影响积分稳定性;(4) 使用四阶龙格-库塔(RK4)推理,相比欧拉法显著降低全局离散化误差。关键发现:这些组件缺一不可——仅用RK4但无平滑速度场会失败,仅平滑仍会漂移,消融实验验证了这一点。此外,结合双视角3D点云编码器(两个独立PointNet),在Franka机械臂和Boston Dynamics Spot四类真实任务中,本方法在两个长时序多阶段任务上分别达到70%和60%总体成功率,基线均为0%;精密工具放置任务达100%成功。三个MetaWorld仿真任务也验证了持续提升,表明轨迹级监督对可靠策略执行至关重要。

原文摘要 · Abstract (English)

Flow matching policies learn continuous velocity fields that transport noise to actions, enabling fast deterministic inference for robot manipulation. However, standard training optimizes a pointwise velocity objective while inference requires numerical integration of that field -- a mismatch that causes compounding trajectory errors. We propose four complementary remedies: (1) auxiliary rectified flow velocity regression that provides uniform temporal supervision across the full time interval; (2) multi-step trajectory consistency training that supervises the integrated displacement of the velocity field over trajectory segments, directly closing the train-inference gap; (3) velocity field regularization that enforces temporal smoothness, preventing oscillations that destabilize integration; and (4) fourth-order Runge-Kutta (RK4) inference that reduces global discretization error by orders of magnitude over Euler methods. Critically, these components are not independently sufficient -- RK4 without a smooth velocity field fails, and smoothness without trajectory-level supervision still drifts, as our ablation study confirms. We further pair these with a dual-view 3D point cloud encoder using two independent PointNet encoders for complementary spatial perception. On four real-robot tasks across a Franka arm and a Boston Dynamics Spot, our method achieves 70% and 60% overall success on two long-horizon multi-phase tasks where both baselines score 0%, and reaches 100% on precision tool placement. Three MetaWorld simulation tasks confirm consistent improvements, validating that trajectory-level supervision is essential for reliable policy execution.

机器人控制流匹配视觉动作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。