arXiv:2503.15386cs.ROcs.AI2025-03中稿 · IROS 2025被引 3

通过引导采样优化模仿学习,让机器人自动修复失败动作。

CCDP: Composition of Conditional Diffusion Policies with Guided Sampling

  • 基于扩散模型分解思想,动态调整采样空间以避开失败动作
  • 仅用成功示范数据即可推断恢复策略,无需额外探索
  • 适合需要自适应容错的复杂机器人任务场景

模仿学习提供了一种直接从数据中学习的途径,无需显式建模、仿真或详细任务定义。推理时,动作从学习到的分布中采样并执行于机器人。然而,采样动作可能因多种原因失败,简单重复采样直到成功效率低下。本文提出一种增强采样策略,通过修正采样分布来避免先前失败的动作。我们证明,仅利用成功示范数据,即可推断出恢复动作,无需额外探索行为或高层控制器。进一步地,我们借助扩散模型分解的思想,将需长时序历史处理失败的主问题,拆分为多个更易管理的子问题,分别在学习、数据收集和推理阶段解决,从而支持系统适应不同数量的失败。该方法生成一个低层控制器,能动态调整采样空间,在先前样本不理想时提升效率。我们在门开启(方向未知)、物体操作及按钮搜索等任务上验证了该方法,结果表明其优于传统基线。

原文摘要 · Abstract (English)

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the robot. However, sampled actions may fail for various reasons, and simply repeating the sampling step until a successful action is obtained can be inefficient. In this work, we propose an enhanced sampling strategy that refines the sampling distribution to avoid previously unsuccessful actions. We demonstrate that by solely utilizing data from successful demonstrations, our method can infer recovery actions without the need for additional exploratory behavior or a high-level controller. Furthermore, we leverage the concept of diffusion model decomposition to break down the primary problem, which may require long-horizon history to manage failures, into multiple smaller, more manageable sub-problems in learning, data collection, and inference, thereby enabling the system to adapt to variable failure counts. Our approach yields a low-level controller that dynamically adjusts its sampling space to improve efficiency when prior samples fall short. We validate our method across several tasks, including door opening with unknown directions, object manipulation, and button-searching scenarios, demonstrating that our approach outperforms traditional baselines.

模仿学习扩散模型机器人控制自修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。