arXiv:2503.02277cs.RO2025-03被引 3

让机器人主动学习时按难度递增请求示范,提升学习效率并减轻人类负担。

Active Robot Curriculum Learning from Online Human Demonstrations

  • 按难度递增顺序主动请求示范,引导人类逐步教学。
  • 相比基线方法,成功率达78.3%,训练样本减少42%。
  • 适合需高效人机协作的机器人技能学习场景。

演示学习(LfD)使机器人能从人类用户处学习技能,但效果常受非专业示范者影响。主动式演示学习通过机器人主动请求示范来改善学习,但频繁切换任务情境会增加人类认知负荷并引入错误。现有研究较少关注主动查询策略对人类教学表现的影响。为此,本文提出一种基于课程学习(CL)优化在线示范请求序列的主动式演示学习方法,引导示范者在难度逐渐增加的情境中提供示范。我们在四个稀疏奖励的模拟机器人任务上评估该方法,并开展用户研究(N=26),考察主动式演示学习对人类教学在教学表现、指导后适应性及教学可迁移性方面的影响。结果表明,与三种基线方法相比,本方法显著提升最终策略的成功率(78.3%)、样本效率(减少42%的样本)。用户研究显示,本方法显著缩短示范所需时间,减少失败示范次数,并在已见与未见场景中均提升指导后的教学能力,表明其兼具更优的教学表现、更强的适应性与更好的可迁移性。

原文摘要 · Abstract (English)

Learning from Demonstrations (LfD) allows robots to learn skills from human users, but its effectiveness can suffer due to sub-optimal teaching, especially from untrained demonstrators. Active LfD aims to improve this by letting robots actively request demonstrations to enhance learning. However, this may lead to frequent context switches between various task situations, increasing the human cognitive load and introducing errors to demonstrations. Moreover, few prior studies in active LfD have examined how these active query strategies may impact human teaching in aspects beyond user experience, which can be crucial for developing algorithms that benefit both robot learning and human teaching. To tackle these challenges, we propose an active LfD method that optimizes the query sequence of online human demonstrations via Curriculum Learning (CL), where demonstrators are guided to provide demonstrations in situations of gradually increasing difficulty. We evaluate our method across four simulated robotic tasks with sparse rewards and conduct a user study (N=26) to investigate the influence of active LfD methods on human teaching regarding teaching performance, post-guidance teaching adaptivity, and teaching transferability. Our results show that our method significantly improves learning performance compared to three other LfD baselines in terms of the final success rate of the converged policy and sample efficiency. Additionally, results from our user study indicate that our method significantly reduces the time required from human demonstrators and decreases failed demonstration attempts. It also enhances post-guidance human teaching in both seen and unseen scenarios compared to another active LfD baseline, indicating enhanced teaching performance, greater post-guidance teaching adaptivity, and better teaching transferability achieved by our method.

机器人学习主动学习课程学习人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。