arXiv:2507.21452cs.LGcs.RO2025-07

用检索增强生成提速扩散策略,无需额外训练

Retrieve-Augmented Generation for Speeding up Diffusion Policy without Additional Training

  • 通过检索专家示范动作,结合中间去噪步骤加速推理
  • 加速20倍时仍比蒸馏模型高7%准确率
  • 适合需要快速部署且不想重训的机器人控制场景

扩散策略(Diffusion Policies, DPs)在模仿学习任务中表现出色,但依赖扩散模型需多步去噪生成动作,导致推理时间长。现有基于知识蒸馏的方法如一致性策略(Consistency Policy, CP)虽能加速,但需大量训练时间,尤其对复杂任务。本文提出RAGDP(Retrieve-Augmented Generation for Diffusion Policies),利用预训练DP编码器构建专家示范的动作-观测向量数据库,在推理时通过当前观测嵌入检索最相似的动作,并与中间去噪步骤结合,减少所需迭代步数。实验表明,RAGDP在不增加训练的前提下,结合基础模型与现有加速方法,显著提升速度与精度平衡。即使实现20倍加速,其准确率仍比CP等蒸馏模型高出7%。

原文摘要 · Abstract (English)

Diffusion Policies (DPs) have attracted attention for their ability to achieve significant accuracy improvements in various imitation learning tasks. However, DPs depend on Diffusion Models, which require multiple noise removal steps to generate a single action, resulting in long generation times. To solve this problem, knowledge distillation-based methods such as Consistency Policy (CP) have been proposed. However, these methods require a significant amount of training time, especially for difficult tasks. In this study, we propose RAGDP (Retrieve-Augmented Generation for Diffusion Policies) as a novel framework that eliminates the need for additional training using a knowledge base to expedite the inference of pre-trained DPs. In concrete, RAGDP encodes observation-action pairs through the DP encoder to construct a vector database of expert demonstrations. During inference, the current observation is embedded, and the most similar expert action is extracted. This extracted action is combined with an intermediate noise removal step to reduce the number of steps required compared to the original diffusion step. We show that by using RAGDP with the base model and existing acceleration methods, we improve the accuracy and speed trade-off with no additional training. Even when accelerating the models 20 times, RAGDP maintains an advantage in accuracy, with a 7% increase over distillation models such as CP.

扩散策略检索增强加速推理机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。