arXiv:2605.21680cs.RO2026-05中稿 · ICRA

VR操控无人机群在未知环境实时探索,人机协同更智能

Flying Together: Human-Guided Immersive Shared Control for Aerial Robot Teams in Unknown Environments

论文配图:Flying Together: Human-Guided Immersive Shared Control for Aerial Robot Teams in Unknown Environments
图 1 · 摘自论文原文
  • 用用户引导的运动基元规划器生成无碰撞轨迹
  • 实测提升避障能力,降低操作者负担
  • 适合需要灵活干预的复杂环境任务

尽管自主多机器人系统可实现安全协调导航,但在非结构化环境中仍难以应对突发情况或捕捉操作者意图。本文提出一种基于虚拟现实(VR)的无人机群共享控制框架,适用于受限且未知环境中的实时用户引导探索。核心是新型用户引导的运动基元规划器,可生成连续无碰撞轨迹,并持续融合操作者输入。该规划器与阻抗控制器结合,使操作者能灵活影响团队行为,引导无人机前往自主规划可能忽略的感兴趣区域。系统支持物理与仿真无人机混合运行,采用双边VR界面,操作者可通过迁移点引导团队,同时获得团队状态的即时视觉反馈。实验表明,共享控制提升了避障性能,保持了机间间距,并降低了操作者工作负荷,验证了沉浸式人机协同多机器人导航的可行性与优势。

原文摘要 · Abstract (English)

While autonomous multi-robots can achieve safe and coordinated navigation, they often struggle to adapt to unforeseen conditions and to capture operator-driven objectives in unstructured environments. We present a Virtual Reality (VR)-based shared control framework for teams of drones operating in constrained and unknown environments, enabling real-time, user-guided exploration. At the core of our approach is a novel, user-guided motion-primitive-based planner that computes continuous, collision-free trajectories while continuously integrating operator input. This planner is coupled with an admittance controller, allowing the operator to flexibly influence team behavior and guide drones toward regions of interest that autonomous planners may overlook. The system supports mixed-reality operations with both physical and simulated drones, and implements a bilateral VR-based interface, allowing the operator to guide the robot team via migration points while receiving immediate visual feedback of the team state. Experimental results show that shared control improves obstacle avoidance, maintains inter-agent spacing, and reduces operator effort, demonstrating the feasibility and advantages of immersive, human-in-the-loop multi-robot navigation.

无人机群人机协同虚拟现实共享控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。