arXiv:2411.01014cs.RO2024-11被引 28

混合现实+智能辅助,让远程操控人形机器人更精准高效

Mixed Reality Teleoperation Assistance for Direct Control of Humanoids

  • 用混合现实叠加虚拟提示,结合自主动作规划
  • 在Nadia机器人上实现90%以上任务成功率
  • 适合需要高精度操作的远程救援或工业场景

远程操作在复杂环境中的机器人作业中至关重要,但现有方法在效率和精度方面仍存在局限。本文提出一种融合混合现实与辅助自主性的新方法,通过概率运动基元(Probabilistic Movement Primitives)、物体检测及可及性模板(Affordance Templates),将用户动作与自主能力结合,在保持类人化运动的同时提升任务效率。在Nadia人形机器人上开展的实验与可行性研究验证了该框架的有效性。

原文摘要 · Abstract (English)

Teleoperation plays a crucial role in enabling robot operations in challenging environments, yet existing limitations in effectiveness and accuracy necessitate the development of innovative strategies for improving teleoperated tasks. This article introduces a novel approach that utilizes mixed reality and assistive autonomy to enhance the efficiency and precision of humanoid robot teleoperation. By leveraging Probabilistic Movement Primitives, object detection, and Affordance Templates, the assistance combines user motion with autonomous capabilities, achieving task efficiency while maintaining human-like robot motion. Experiments and feasibility studies on the Nadia robot confirm the effectiveness of the proposed framework.

远程操控混合现实人形机器人辅助自主

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。