低成本虚拟手臂辅助系统,让新手安全快速学会远程操控机器人。
TelePreview: A User-Friendly Teleoperation System with Virtual Arm Assistance for Enhanced Effectiveness
- 通过虚拟臂实时预览动作,直观展示人体输入与机器人动作的映射关系。
- 在五个任务中表现优于现有系统,部署成本低于1000美元。
- 适合机器人教学、数据采集及跨平台远程操作,上手快且安全性高。
遥操作是获取机器人示范数据的有效方式,对机器人学习至关重要。然而,由于人手与机器人手形态差异,新用户难以理解动作映射,且操作存在安全隐患。为此,我们提出TelePreview系统,仅需不到1000美元硬件成本,通过虚拟机器人实时预览用户下一步动作,实现命令可视化与实际执行的灵活切换。该系统显著提升新用户的操作学习效率与安全性。我们在五个任务中验证其性能,结果表明其优于其他遥操作系统,且可轻松部署于多种机器人平台。代码与部署文档已公开于https://nus-lins-lab.github.io/telepreview-web/。
原文摘要 · Abstract (English)
Teleoperation provides an effective way to collect robot data, which is crucial for learning from demonstrations. In this field, teleoperation faces several key challenges: user-friendliness for new users, safety assurance, and transferability across different platforms. While collecting real robot dexterous manipulation data by teleoperation to train robots has shown impressive results on diverse tasks, due to the morphological differences between human and robot hands, it is not only hard for new users to understand the action mapping but also raises potential safety concerns during operation. To address these limitations, we introduce TelePreview. This teleoperation system offers real-time visual feedback on robot actions based on human user inputs, with a total hardware cost of less than $1,000. TelePreview allows the user to see a virtual robot that represents the outcome of the user's next movement. By enabling flexible switching between command visualization and actual execution, this system helps new users learn how to demonstrate quickly and safely. We demonstrate that it outperforms other teleoperation systems across five tasks, emphasize its ease of use, and highlight its straightforward deployment across diverse robotic platforms. We release our code and a deployment document on our website https://nus-lins-lab.github.io/telepreview-web/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。