arXiv:2412.14309cs.ROcs.HC2024-12被引 9

提出一套评估机器人示范数据质量的直观指标,提升学习成功率。

Consistency Matters: Defining Demonstration Data Quality Metrics in Robot Learning from Demonstration

  • 通过分析运动数据特征,定义能预测学习效果的一致性指标。
  • 在两个实验中,一致性能准确预测70%至89%的任务成功率。
  • 无需专家数据或算法修改,适合普通用户使用。

从示范学习(LfD)使机器人可通过人类示范掌握新技能,便于普通人教学。然而学习与泛化效果高度依赖示范质量。尽管一致性常被视作质量指标,其具体构成仍不明确。本文评估了一系列运动数据特征,确定哪些一致性度量能最好预测学习表现。通过训练前确保示范一致性,提升了模型的预测准确性和在新场景中的泛化能力。我们通过两项用户研究验证方法:第一项(N=24)让参与者教PR2机器人完成按钮按压任务;第二项(N=30)让参与者训练UR5机器人完成抓取放置任务。结果显示,示范一致性显著影响学习与泛化成功率,两项研究中任务成功率分别有70%和89%可被我们的指标预测。此外,对泛化表现的成功率预测准确率达76%和91%。结果表明,这些度量提供了一种直观、实用的示范数据质量评估方式,无需专家数据或算法调整,系统性填补了LfD中关于一致性度量的空白,增强了机器人从人类示范学习的可靠性。

原文摘要 · Abstract (English)

Learning from Demonstration (LfD) empowers robots to acquire new skills through human demonstrations, making it feasible for everyday users to teach robots. However, the success of learning and generalization heavily depends on the quality of these demonstrations. Consistency is often used to indicate quality in LfD, yet the factors that define this consistency remain underexplored. In this paper, we evaluate a comprehensive set of motion data characteristics to determine which consistency measures best predict learning performance. By ensuring demonstration consistency prior to training, we enhance models' predictive accuracy and generalization to novel scenarios. We validate our approach with two user studies involving participants with diverse levels of robotics expertise. In the first study (N = 24), users taught a PR2 robot to perform a button-pressing task in a constrained environment, while in the second study (N = 30), participants trained a UR5 robot on a pick-and-place task. Results show that demonstration consistency significantly impacts success rates in both learning and generalization, with 70% and 89% of task success rates in the two studies predicted using our consistency metrics. Moreover, our metrics estimate generalized performance success rates with 76% and 91% accuracy. These findings suggest that our proposed measures provide an intuitive, practical way to assess demonstration data quality before training, without requiring expert data or algorithm-specific modifications. Our approach offers a systematic way to evaluate demonstration quality, addressing a critical gap in LfD by formalizing consistency metrics that enhance the reliability of robot learning from human demonstrations.

机器人学习示范学习数据质量一致性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。