arXiv:2601.23087cs.RO2026-01被引 3

通过隐空间流匹配实现机器人操作的高效稳定长时序模仿学习

CoLA-Flow Policy: Temporally Coherent Imitation Learning via Continuous Latent Action Flow Matching for Robotic Manipulation

  • 在连续隐动作空间中进行流匹配,分离运动结构与控制噪声
  • 近单步推理,轨迹平滑度提升93.7%,任务成功率提高25个百分点
  • 支持视觉条件调节,适合真实场景下的复杂操作任务

长时序机器人操作学习需兼顾强表达能力、实时推理与稳定执行,现有生成式策略面临挑战。基于扩散的方法建模能力强但推理延迟高,而直接在原始动作空间进行流匹配虽速度快,却常导致执行不稳定。我们提出连续隐动作流策略(CoLA-Flow Policy),一种轨迹级模仿学习框架,在连续隐动作空间中执行流匹配。通过将动作序列编码为时间一致的隐轨迹并学习显式隐空间流,该方法解耦全局运动结构与低层控制噪声,实现平滑可靠的长时序执行。框架进一步结合几何感知点云条件输入与执行时多模态调制,以视觉线索为代表增强真实环境鲁棒性。仿真与真实机器人实验表明,CoLA-Flow Policy 实现近单步推理,相比原始动作空间流基线,轨迹平滑度提升最高达93.7%,任务成功率提升最高达25个百分点,且显著快于基于扩散的策略。

原文摘要 · Abstract (English)

Learning long-horizon robotic manipulation requires jointly achieving expressive behavior modeling, real-time inference, and stable execution, which remains challenging for existing generative policies. Diffusion-based approaches offer strong modeling capacity but incur high inference latency, while flow matching enables fast, near-single-step generation yet often suffers from unstable execution when operating directly in the raw action space. We propose Continuous Latent Action Flow Policy (CoLA-Flow Policy), a trajectory-level imitation learning framework that performs flow matching in a continuous latent action space. By encoding action sequences into temporally coherent latent trajectories and learning an explicit latent-space flow, CoLA-Flow Policy decouples global motion structure from low-level control noise, enabling smooth and reliable long-horizon execution. The framework further integrates geometry-aware point cloud conditioning and execution-time multimodal modulation, using visual cues as a representative modality to enhance real-world robustness. Experiments in simulation and on real robots show that CoLA-Flow Policy achieves near-single-step inference, improves trajectory smoothness by up to 93.7% and task success by up to 25 percentage points over raw action-space flow baselines, while remaining significantly faster than diffusion-based policies.

机器人操作流匹配隐空间模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。