arXiv:2505.03296cs.ROcs.AI2025-05被引 5

用少量视觉演示即可让机器人学会复杂操作,还能跨任务迁移。

The Unreasonable Effectiveness of Discrete-Time Gaussian Process Mixtures for Robot Policy Learning

  • 基于离散时间高斯过程混合模型,仅需5次示范即能学习复杂动作
  • 在约束任务上成功率提升76个百分点,样本效率提高20倍
  • 支持碰撞避让与跨机器人迁移,适合少样本强化学习场景

我们提出混合离散时间高斯过程(MiDiGap),一种用于机器人操作策略表示与模仿学习的新方法。该方法仅需5个演示视频即可从相机观测中学习,并在多种挑战性任务中实现良好泛化。其擅长长时序行为(如煮咖啡)、高度约束运动(如开门)、动态动作(如用铲子舀取)以及多模态任务(如挂杯子)。所有训练可在单台CPU上于1分钟内完成,且可线性扩展至大规模数据集。我们还开发了一套推理阶段的调控工具,利用碰撞信号和机器人运动学约束实现路径引导,从而支持障碍物避让与跨体感策略迁移。在多个少样本操作基准测试中,MiDiGap达到领先性能:在受限的RLBench任务上,成功率提升76个百分点,轨迹成本降低67%;在多模态任务上,成功率提升48个百分点,样本效率提升20倍;在跨体感迁移中,成功率翻倍以上。代码已公开:https://midigap.cs.uni-freiburg.de。

原文摘要 · Abstract (English)

We present Mixture of Discrete-time Gaussian Processes (MiDiGap), a novel approach for flexible policy representation and imitation learning in robot manipulation. MiDiGap enables learning from as few as five demonstrations using only camera observations and generalizes across a wide range of challenging tasks. It excels at long-horizon behaviors such as making coffee, highly constrained motions such as opening doors, dynamic actions such as scooping with a spatula, and multimodal tasks such as hanging a mug. MiDiGap learns these tasks on a CPU in less than a minute and scales linearly to large datasets. We also develop a rich suite of tools for inference-time steering using evidence such as collision signals and robot kinematic constraints. This steering enables novel generalization capabilities, including obstacle avoidance and cross-embodiment policy transfer. MiDiGap achieves state-of-the-art performance on diverse few-shot manipulation benchmarks. On constrained RLBench tasks, it improves policy success by 76 percentage points and reduces trajectory cost by 67%. On multimodal tasks, it improves policy success by 48 percentage points and increases sample efficiency by a factor of 20. In cross-embodiment transfer, it more than doubles policy success. We make the code publicly available at https://midigap.cs.uni-freiburg.de.

机器人学习少样本高斯过程策略迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。