arXiv:2607.29482cs.RO2026-07中稿 · the 2026 IEEE/RSJ …

用历史状态初始化生成模型,让机器人模仿学习更高效

Temporal Policy: History-Initialized Action Generation for Robotic Learning from Demonstration

论文配图:Temporal Policy: History-Initialized Action Generation for Robotic Learning from Demonstration
图 1 · 摘自论文原文
  • 基于历史状态初始化的随机插值,实现动作序列的时序耦合生成
  • 推理延迟仅19.1毫秒,运输成本降低近十倍,成功率与顶尖方法相当
  • 适合需要高频闭环控制的机器人实操场景

传统扩散和流匹配模型依赖无信息的高斯先验,被迫学习复杂且高开销的向量场以到达物理动作空间。生成模型在机器人示范学习中擅长捕捉多模态行为,但推理成本高。本文提出Temporal Policy,一种基于随机插值的生成框架,将动作生成建模为时序耦合的传输问题。通过以机器人近期历史状态初始化生成流,显式地将过去状态与未来动作序列耦合,降低传输成本并生成更平直的向量场。在视觉-运动仿真基准和物理级Barrett WAM 2x 7DoF遥操作平台上验证,该方法相比噪声初始化基线,运输成本降低近一个数量级,在单张NVIDIA RTX 4080上实现19.1毫秒推理延迟。关键优势在于在保持先进基线成功率的同时,显著提升几何与计算效率,突破独立高斯先验带来的计算瓶颈,支持高频闭环控制。代码已开源。

原文摘要 · Abstract (English)

By relying on independent couplings from uninformative Gaussian priors, standard diffusion and flow matching models are forced to learn complex, high-cost vector fields to reach the physical action space. Generative models excel at capturing multimodal behaviors for robotic Learning from Demonstration (LfD), but often suffer from high inference cost. This paper introduces Temporal Policy, a generative framework based on stochastic interpolants that formulates action generation as a temporally coupled transport problem. By initializing the generative flow at the robot's recent history, we explicitly couple past states to future action sequences. This data-dependent coupling reduces transport cost and produces straight vector fields. We validate Temporal Policy across visuomotor simulation benchmarks and on a physical Barrett WAM 2x 7DoF teleoperation platform. Our approach reduces transport costs by nearly an order of magnitude compared to noise-initialized baselines, achieving a 19.1 ms inference latency on a single NVIDIA RTX 4080. Crucially, these geometric and computational efficiencies are achieved while matching the success rates of state-of-the-art baselines. This simplified transport geometry bypasses the computational bottleneck of independent Gaussian priors, helping enable high-frequency, closed-loop control. The code is publicly available at https://github.com/dmiller12/TemporalPolicy.

机器人学习生成模型动作生成高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。