arXiv:2502.12724cs.RO2025-02被引 8

提出新型扩散策略,让机器人响应更快、控制更准。

Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control

  • 用噪声传递缓存和分步去噪,实现即时动作生成
  • 响应任务成功率提升18%,常规任务比DDIM高6.9%
  • 适合需要快速反应的机器人控制场景

模仿学习是教会机器人完成多种任务的有效方法。扩散策略利用条件去噪扩散过程生成动作,在多模态示范学习中表现优异。然而,它依赖同一推理步骤生成多个动作以保持性能并避免模式跳变,限制了响应速度,因为动作未基于最新观测。为此,我们提出响应式噪声传递扩散策略(RNR-DP),维护一个噪声水平逐级升高的噪声传递缓冲区,并采用序列去噪机制,在序列头部生成无噪声的即时动作,尾部添加带噪声的动作。这确保动作对最新观测有响应性,同时通过噪声传递缓冲维持运动一致性。该设计可处理需快速响应的任务,并通过复用去噪步骤加速动作生成。在响应敏感任务上的实验表明,相比扩散策略,本方法成功率提升18%。在常规任务上的进一步评估显示,RNR-DP在成功率上超过最佳加速方法DDIM 6.9%,凸显其在非严格响应场景下的计算效率优势。

原文摘要 · Abstract (English)

Imitation learning is an efficient method for teaching robots a variety of tasks. Diffusion Policy, which uses a conditional denoising diffusion process to generate actions, has demonstrated superior performance, particularly in learning from multi-modal demonstrates. However, it relies on executing multiple actions predicted from the same inference step to retain performance and prevent mode bouncing, which limits its responsiveness, as actions are not conditioned on the most recent observations. To address this, we introduce Responsive Noise-Relaying Diffusion Policy (RNR-DP), which maintains a noise-relaying buffer with progressively increasing noise levels and employs a sequential denoising mechanism that generates immediate, noise-free actions at the head of the sequence, while appending noisy actions at the tail. This ensures that actions are responsive and conditioned on the latest observations, while maintaining motion consistency through the noise-relaying buffer. This design enables the handling of tasks requiring responsive control, and accelerates action generation by reusing denoising steps. Experiments on response-sensitive tasks demonstrate that, compared to Diffusion Policy, ours achieves 18% improvement in success rate. Further evaluation on regular tasks demonstrates that RNR-DP also exceeds the best acceleration method (DDIM) by 6.9% in success rate, highlighting its computational efficiency advantage in scenarios where responsiveness is less critical. Our project page is available at https://rnr-dp.github.io

扩散模型机器人控制动作生成高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。