用AR远程操控机器人采集演示数据,提升操作效率与体验。
Augmented Reality-Enhanced Robot Teleoperation for Collecting User Demonstrations
- 结合AR控制与点云渲染,实现无接触远程操作。
- 任务完成准确率提升28%,用户满意度提高12%。
- 适合工业场景下快速收集机器人学习数据。
传统工业机器人编程复杂耗时,需数周至数月。尽管示范编程(PbD)更易用,但直观的控制界面仍具挑战。为此,我们提出一种增强现实(AR)辅助的机器人遥操作系统,融合AR控制与空间点云渲染,实现无需进入工作区或使用示教器的非接触式演示采集。该系统通用性强,已在ABB机器人平台验证,包括IRB 1200工业机器人和GoFa 5协作机器人。用户研究对比了实时环境感知(有无点云渲染)对任务完成精度、效率及用户信心的影响。结果显示,增强感知使任务性能提升28%,系统可用性量表(SUS)得分提高12%。本工作推动了直观遥操作、AR交互设计、环境感知与安全机制的发展,所采集演示数据可为机器学习训练提供支持。
原文摘要 · Abstract (English)
Traditional industrial robot programming is often complex and time-consuming, typically requiring weeks or even months of effort from expert programmers. Although Programming by Demonstration (PbD) offers a more accessible alternative, intuitive interfaces for robot control and demonstration collection remain challenging. To address this, we propose an Augmented Reality (AR)-enhanced robot teleoperation system that integrates AR-based control with spatial point cloud rendering, enabling intuitive, contact-free demonstrations. This approach allows operators to control robots remotely without entering the workspace or using conventional tools like the teach pendant. The proposed system is generally applicable and has been demonstrated on ABB robot platforms, specifically validated with the IRB 1200 industrial robot and the GoFa 5 collaborative robot. A user study evaluates the impact of real-time environmental perception, specifically with and without point cloud rendering, on task completion accuracy, efficiency, and user confidence. Results indicate that enhanced perception significantly improves task performance by 28% and enhances user experience, as reflected by a 12% increase in the System Usability Scale (SUS) score. This work contributes to the advancement of intuitive robot teleoperation, AR interface design, environmental perception, and teleoperation safety mechanisms in industrial settings for demonstration collection. The collected demonstrations may serve as valuable training data for machine learning applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。