测试无人机与地面车协同,发现现有模型难实现稳定合作。
Can Aerial VLA Models Cooperate? Evaluating Closed-Loop Air-Ground Coordination with CARLA-Air

- 构建统一仿真环境CARLA-Air,实现空地系统物理一致交互。
- 多任务测试显示,现有模型仅能跟踪但无法稳定协作。
- 需显式状态对齐、低延迟协调和团队目标对齐才能实现合作。
近期的空中视觉-语言-动作(VLA)模型在单架无人机任务中表现良好,如追踪移动目标或导航至语言指定地标。然而,这些能力能否迁移到空地协同场景仍不明确,该场景要求无人机(UAV)与地面机器人(UGV)在共享的闭环物理世界中协同行动。本文通过CARLA-Air——一个集成CARLA与AirSim于同一Unreal Engine运行时的单进程仿真环境——开展研究。该环境共享世界状态、物理时钟和感知管道,实现物理一致的空地交互,并精确测量仿真时间戳对齐与有效协同延迟。在两个互补诊断任务(移动平台着陆与遮挡恢复护送)上评估代表性空中VLA与规划基线,结果表明:当前模型虽可追踪或跟随地面伙伴,但难以将单机能力转化为稳定协作行为;状态提示作用有限,盲目双向交互不仅未提升性能,反而放大多数基线的错误。研究揭示,在当前基于文本提示的接口下,零样本空地协同需超越现有范式:显式伙伴状态对齐、低延迟动作协调与团队级目标对齐。代码已开源。
原文摘要 · Abstract (English)
Recent aerial vision-language-action (VLA) models show promising single-UAV capabilities, such as tracking moving objects and navigating to language-specified landmarks. However, it remains unclear whether these capabilities can transfer to air-ground cooperation, where a UAV and a UGV must act jointly in a shared, closed-loop physical world. We study this question with CARLA-Air, a single-process air-ground evaluation environment that unifies CARLA and AirSim inside one Unreal Engine runtime. By sharing the same world state, physics tick, and sensing pipeline, CARLA-Air enables physically consistent UAV--UGV interaction and precise measurement of simulation-timestamp alignment and effective coordination latency. Using CARLA-Air, we evaluate representative aerial VLA and planning baselines on two complementary diagnostic tasks: moving-platform landing and occlusion-recovery escort. The results show that current aerial VLA models can often track or follow a ground partner, but struggle to convert this single-agent competence into stable cooperative behavior. State prompting provides limited benefit, and naive bidirectional interaction fails to consistently improve performance and can amplify errors for most baselines. These findings suggest that, under the tested text-based cue interfaces, zero-shot cooperative air-ground VLA requires three components beyond the current paradigm: explicit partner-state grounding, low-latency action coordination, and team-level objective alignment. Our code is available at https://github.com/louiszengCN/CarlaAir.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。