arXiv:2506.15009cs.RO2025-06中稿 · IROS 2025被引 5

用手部动作控制飞行机器人,实现六自由度精准操作

Six-DoF Hand-Based Teleoperation for Omnidirectional Aerial Robots

  • 用肩部与手部追踪器+数据手套捕捉手部动作
  • 设计四种模式,支持远距离移动、精确操控与无缝切换
  • 在真实阀门转动任务中验证,提升复杂环境操控能力

全向飞行机器人具备位置与姿态的六自由度独立控制,广泛应用于空中操作。尽管机器人自主性不断提升,复杂空域中仍需人类操作。现有遥控方式未能充分利用全向旋转带来的额外自由度,且未充分调动人手灵活性。本文提出一种基于手部动作的飞行遥控系统,将人体手部旋转灵活度引入无界空中作业空间。系统采用肩部与手部双追踪标记组,结合数据手套捕捉手势。基于此输入,设计四种交互模式:适用于长距离移动的球面模式与笛卡尔模式,用于精细操作的操作模式,以及支持临时暂停的锁定模式。手部动作实现模式间无缝切换。在真实垂直安装阀门转动任务中进行评估,验证各模式对高效空中操作的贡献。该交互框架实现了人手灵巧性与空中机器人控制的融合,为非结构化环境中增强遥操作提供了新路径。

原文摘要 · Abstract (English)

Omnidirectional aerial robots offer full 6-DoF independent control over position and orientation, making them popular for aerial manipulation. Although advancements in robotic autonomy, human operation remains essential in complex aerial environments. Existing teleoperation approaches for multirotors fail to fully leverage the additional DoFs provided by omnidirectional rotation. Additionally, the dexterity of human fingers should be exploited for more engaged interaction. In this work, we propose an aerial teleoperation system that brings the rotational flexibility of human hands into the unbounded aerial workspace. Our system includes two motion-tracking marker sets--one on the shoulder and one on the hand--along with a data glove to capture hand gestures. Using these inputs, we design four interaction modes for different tasks, including Spherical Mode and Cartesian Mode for long-range moving, Operation Mode for precise manipulation, as well as Locking Mode for temporary pauses, where the hand gestures are utilized for seamless mode switching. We evaluate our system on a vertically mounted valve-turning task in the real world, demonstrating how each mode contributes to effective aerial manipulation. This interaction framework bridges human dexterity with aerial robotics, paving the way for enhanced aerial teleoperation in unstructured environments.

飞行机器人遥操作手部追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。