arXiv:2606.04111cs.ROcs.AI2026-06

用多视角扩散模型提升无人机室内导航效率与成功率

AgenticDiffusion: Agentic Diffusion-based Path Planning for Vision-Based UAV Navigation

论文配图:AgenticDiffusion: Agentic Diffusion-based Path Planning for Vision-Based UAV Navigation
图 1 · 摘自论文原文
  • 融合语言指令与多视角视觉,动态选择最优观测点
  • 真实场景测试中任务成功率80%,轨迹生成成功率达100%
  • 适合需要自主探索与复杂环境导航的无人机应用

室内无人机导航需在视场受限条件下实现高效探索、场景理解与可靠轨迹执行。现有基于视觉的导航框架通常依赖单视角观测,难以推理遮挡、目标可见性与全局场景结构。本文提出AgenticDiffusion,一种多视角无人机导航框架,统一集成语言引导推理、开放词汇目标定位、基于视觉的扩散规划与NMPC。给定自然语言指令及同步的第一人称视角(FPV)与俯视图观测,该框架确定最具信息量的观测视角并生成任务计划后再执行轨迹。通过开放词汇定位模型识别目标,各视角专用的扩散规划器生成可执行路径。利用互补视角,该框架减少重复探索,提升复杂室内环境下的导航效率。在四个真实世界无人机导航场景中验证:自适应视角选择、多阶段任务执行、长时程导航与安全着陆点选择。40次真实试验中总体任务成功率达80%,扩散规划器轨迹生成成功率为100%。

原文摘要 · Abstract (English)

Indoor UAV navigation requires efficient exploration, scene understanding, and reliable trajectory execution under limited field-of-view observations. Existing vision-based navigation frameworks typically rely on single-view observations, limiting their ability to reason about occlusions, target visibility, and global scene structure. In this work, we propose AgenticDiffusion, a multi-view UAV navigation framework that coordinates language-guided reasoning, open-vocabulary target grounding, vision-based diffusion planning, and NMPC within a unified aerial navigation pipeline. Given a natural language instruction and synchronized first-person-view (FPV) and top-view observations, the framework determines the most informative viewpoint for navigation and generates a mission plan prior to trajectory execution. The targets are localized using an open-vocabulary grounding model, after which viewpoint-specific diffusion planners generate navigation trajectories for UAV execution. Using complementary viewpoints, the proposed framework reduces repeated target exploration and improves navigation efficiency in cluttered indoor environments. The framework was validated in four real-world UAV navigation scenarios involving adaptive viewpoint selection, multi-stage mission execution, long-horizon navigation, and safe landing-site selection. The experimental results demonstrated an overall mission success rate of 80% in 40 real-world trials, while the diffusion planners achieved a trajectory generation success rate of 100%.

无人机导航扩散模型多视角感知语言引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。