arXiv:2602.08245cs.ROcs.AI2026-02中稿 · ICML被引 5

用时空一致性预测加速扩散策略,让机器人动作又快又准。

STEP: Warm-Started Visuomotor Policies with Spatiotemporal Consistency Prediction

  • 通过轻量级时空预测生成高质量预启动动作,保持分布一致性和时间连续性。
  • 2步采样即达21.6%成功率提升,实测任务中比现有方法更稳定高效。
  • 适合对实时性要求高的机器人操控场景,尤其适合真实世界部署。

扩散策略在机器人操作中因能建模动作序列分布和捕捉多模态而表现强劲,但迭代去噪导致推理延迟高,限制了闭环系统中的控制频率。现有加速方法或减少采样步数、或绕过扩散直接预测、或复用历史动作,但难以兼顾动作质量与低延迟。本文提出STEP,一种轻量级时空一致性预测机制,构建高质量的预启动动作,使其在分布上接近目标动作且时间上连续,不牺牲原始扩散策略的生成能力。进一步提出速度感知扰动注入机制,根据动作时序变化自适应调节驱动力,防止真实任务中执行停滞。理论分析表明,该预测诱导局部压缩映射,保障扩散精炼过程中的动作误差收敛。在九个仿真基准和两个真实任务上进行大量评估,结果表明,使用2步采样的STEP在RoboMimic基准和真实任务上分别比BRIDGER和DDIM平均提升21.6%和27.5%的成功率。实验验证了STEP在推理延迟与成功率之间的帕累托前沿持续领先现有方法。代码已公开于https://github.com/Kimho666/STEP。

原文摘要 · Abstract (English)

Diffusion policies have recently emerged as a powerful paradigm for visuomotor control in robotic manipulation due to their ability to model the distribution of action sequences and capture multimodality. However, iterative denoising leads to substantial inference latency, limiting control frequency in real-time closed-loop systems. Existing acceleration methods either reduce sampling steps, bypass diffusion through direct prediction, or reuse past actions, but often struggle to jointly preserve action quality and achieve consistently low latency. In this work, we propose STEP, a lightweight spatiotemporal consistency prediction mechanism to construct high-quality warm-start actions that are both distributionally close to the target action and temporally consistent, without compromising the generative capability of the original diffusion policy. Then, we propose a velocity-aware perturbation injection mechanism that adaptively modulates actuation excitation based on temporal action variation to prevent execution stall especially for real-world tasks. We further provide a theoretical analysis showing that the proposed prediction induces a locally contractive mapping, ensuring convergence of action errors during diffusion refinement. We conduct extensive evaluations on nine simulated benchmarks and two real-world tasks. Notably, STEP with 2 steps can achieve an average 21.6% and 27.5% higher success rate than BRIDGER and DDIM on the RoboMimic benchmark and real-world tasks, respectively. These results demonstrate that STEP consistently advances the Pareto frontier of inference latency and success rate over existing methods.The code is publicly available at https://github.com/Kimho666/STEP.

机器人控制扩散模型加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。