arXiv:2503.07017cs.ROcs.LG2025-03ICRA被引 25

对比不同示范方式对机器人学习效果的影响,发现亲身体验指导最优但难规模化。

How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learning

  • 对比了物理引导、VR控制器和空间鼠标三种示范方式。
  • 物理引导数据最干净,下游学习性能最佳,用户感知最直观。
  • 提出小样本物理引导+大量远程操作混合采集方案,兼顾效果与效率。

模仿学习利用用户提供数据训练机器人策略。示范方式(即示范模态)影响数据质量。尽管现有研究显示,物理引导(让用户直接移动机器人)在直观性和易用性上受用户欢迎,但多数现有操作数据集仍通过虚拟现实控制器或空间鼠标远程操作获取。本文研究不同示范模态对下游学习性能及用户体验的影响,比较了低成本的三种方式:物理引导、基于VR控制器的远程操作、基于空间鼠标的远程操作。在三个具有不同运动约束的桌面操作任务上进行实验,评估不同模态数据下的模仿学习表现,并收集用户主观反馈。结果表明,物理引导在控制直观性上评分最高,提供的数据最清晰,实现最佳学习性能。然而,由于体力负担,不适合作为大规模数据采集方式。基于此洞察,本文提出一种简单数据采集方案:少量物理引导示范搭配大量远程操作数据,实现整体学习性能最优的同时降低数据采集成本。

原文摘要 · Abstract (English)

Imitation learning is a promising approach for learning robot policies with user-provided data. The way demonstrations are provided, i.e., demonstration modality, influences the quality of the data. While existing research shows that kinesthetic teaching (physically guiding the robot) is preferred by users for the intuitiveness and ease of use, the majority of existing manipulation datasets were collected through teleoperation via a VR controller or spacemouse. In this work, we investigate how different demonstration modalities impact downstream learning performance as well as user experience. Specifically, we compare low-cost demonstration modalities including kinesthetic teaching, teleoperation with a VR controller, and teleoperation with a spacemouse controller. We experiment with three table-top manipulation tasks with different motion constraints. We evaluate and compare imitation learning performance using data from different demonstration modalities, and collected subjective feedback on user experience. Our results show that kinesthetic teaching is rated the most intuitive for controlling the robot and provides cleanest data for best downstream learning performance. However, it is not preferred as the way for large-scale data collection due to the physical load. Based on such insight, we propose a simple data collection scheme that relies on a small number of kinesthetic demonstrations mixed with data collected through teleoperation to achieve the best overall learning performance while maintaining low data-collection effort.

模仿学习机器人数据采集人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。