用规划生成数据训练扩散策略,让机械臂更灵活地抓取各类物体。
Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation
- 用物理仿真中的规划生成大量高质量动作轨迹作为训练数据
- 在多种未知物体上实现稳定操控,真实世界测试成功率超80%
- 适合需要高泛化能力的复杂双臂操作任务
接触丰富的双臂操作需要精确协调两只手臂,通过选择性接触和运动改变物体状态。由于任务本身的复杂性,获取足够的演示数据并训练能在未见场景中泛化的策略仍是未解难题。我们基于接触规划的最新进展,提出可泛化的规划引导扩散策略学习(GLIDE),利用基于模型的运动规划器在高保真物理仿真中生成演示数据。通过在随机环境中高效规划,该方法生成了涵盖多种物体与变换的大规模高质量合成运动轨迹。随后,我们使用这些演示数据,通过行为克隆训练任务条件扩散策略。为缓解仿真到现实的差距,我们设计了特征提取、任务表示、动作预测和数据增强等方面的必要选项,使模型能够学习平滑动作序列并泛化至未见场景。在仿真与真实世界中的实验表明,该方法能使双臂机器人有效操控几何形状、尺寸和物理属性各异的物体。
原文摘要 · Abstract (English)
Contact-rich bimanual manipulation involves precise coordination of two arms to change object states through strategically selected contacts and motions. Due to the inherent complexity of these tasks, acquiring sufficient demonstration data and training policies that generalize to unseen scenarios remain a largely unresolved challenge. Building on recent advances in planning through contacts, we introduce Generalizable Planning-Guided Diffusion Policy Learning (GLIDE), an approach that effectively learns to solve contact-rich bimanual manipulation tasks by leveraging model-based motion planners to generate demonstration data in high-fidelity physics simulation. Through efficient planning in randomized environments, our approach generates large-scale and high-quality synthetic motion trajectories for tasks involving diverse objects and transformations. We then train a task-conditioned diffusion policy via behavior cloning using these demonstrations. To tackle the sim-to-real gap, we propose a set of essential design options in feature extraction, task representation, action prediction, and data augmentation that enable learning robust prediction of smooth action sequences and generalization to unseen scenarios. Through experiments in both simulation and the real world, we demonstrate that our approach can enable a bimanual robotic system to effectively manipulate objects of diverse geometries, dimensions, and physical properties. Website: https://glide-manip.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。