arXiv:2609.03483cs.ROcs.AI2026-09

无人机与地面机器人共享鸟瞰图,协同完成视觉语言导航任务。

Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps

论文配图:Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps
图 1 · 摘自论文原文
  • 通过共享鸟瞰地图实现空地协同,无人机标注目标与位置,地面车获取全局路径规划信息。
  • 在CARLA-Air场景中联合成功率77.0%,比最弱单智能体提升27.0个百分点。
  • 无需训练,利用现有模型互补优势,适合无人系统协同导航研究者。

空地协同视觉语言导航(AGC-VLN)将具备全局鸟瞰视图的无人机(UAV)与具备局部第一人称视图的地面机器人(UGV)结合,但该场景仍待深入探索:现有无训练方法仅解决单智能体任务,缺乏协作机制;近期在CARLA-Air上的评估发现,五种先进视觉语言代理(VLA)模型均未表现出稳定协作行为,而简单的语义通信或双向耦合甚至降低性能。本文提出首个无训练基准方法AGC-VLN,核心思想是将导航分解为基于视觉语言模型(VLM)的语义推理与确定性几何执行,从而暴露协作接口:无人机在其全局视图上渲染地面车报告的位置及由VLM锚定的目标,并添加距离标签,生成共享鸟瞰图。地面车据此获取其第一视角无法提供的全局空间上下文,使用冻结的VLM规划道路跟随路径,并在闭环控制下执行;同时,无人机运行3D-SPF——SPF的空间搜索升级版,用于在俯视图中定位目标并朝其飞行。在CARLA-Air Town10HD场景的100次闭环测试中,AGC-VLN达成77.0%的联合成功率达,相比表现较弱的单个智能体(无人机,50.0%)提升27.0个百分点,超过最强公开单智能体基线(Travel UAV,53.0%)24.0个百分点,源于无人机全局视野与地面车道路执行能力的互补性。项目页面:https://github.com/ZSN2024/AGC-VLN。

原文摘要 · Abstract (English)

Air-ground collaborative Vision-and-Language Navigation (VLN) pairs an unmanned aerial vehicle (UAV) with a global bird's-eye view and an unmanned ground vehicle (UGV) with a local first-person view, yet the setting remains largely unexplored: existing training-free methods solve single-agent tasks but offer no collaboration mechanism, and a recent CARLA-Air evaluation found no stable cooperative behavior across five state-of-the-art VLA models; naive semantic communication or bidirectional coupling even degrades performance. We establish AGC-VLN (Air-Ground Collaborative VLN), the first training-free baseline for air-ground collaborative VLN. The key insight is that training-free methods decompose navigation into VLM-based semantic reasoning and deterministic geometric execution, exposing a collaboration interface: the UAV's global view, over which it renders the UGV's reported pose and the VLM-anchored target as CAR/GOAL markers with distance labels, yielding a shared bird's-eye map. From this map, the UGV acquires global spatial context its first-person view cannot provide, plans a road-following path with a frozen VLM, and executes it under closed-loop control; in parallel, the UAV runs 3D-SPF, a spatial-search upgrade of SPF that localizes the target in the downward view and flies toward it. On 100 closed-loop episodes in CARLA-Air's Town10HD scene, AGC-VLN reaches a 77.0% joint success rate, a collaboration gain of +27.0% over the weaker individual agent (the UAV, 50.0%), and exceeds the strongest published single-agent baseline (Travel UAV, 53.0%) by 24.0 points, stemming from the complementarity of the UAV's global view and the UGV's road-following execution. Project page: https://github.com/ZSN2024/AGC-VLN.

空地协同视觉语言导航鸟瞰图无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。