arXiv:2602.00551cs.ROcs.CV2026-02被引 6

无人机视觉导航新框架,高效找目标且决策可解释。

APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation

  • 分层异步架构,用视觉语言模型动态构建三维地图记忆
  • 在复杂空域任务中提升4.2%成功率和2.8%路径效率
  • 适合需要自主探索与精准定位的无人机智能系统

空中目标导航是具身智能领域的前沿挑战,要求无人机仅通过视觉感知和语言描述自主探索、推理并识别特定目标。现有方法在复杂空域中难以有效记忆空间结构、做出可靠可解释的动作决策,且探索效率低下。为此,我们提出 extbf{APEX}(Aerial Parallel Explorer),一种新型分层代理架构,用于复杂空域中的高效探索与目标获取。APEX 采用模块化三部分设计:1)动态时空语义记忆,利用视觉语言模型(VLM)的零样本能力动态构建高分辨率吸引力、探索区与障碍物三维地图,作为可解释的记忆机制;2)动作决策模块,基于强化学习训练,将空间理解转化为细粒度稳健控制策略;3)目标定位模块,采用开放词汇检测器实现确定且泛化的目标识别。所有组件集成于分层、异步、并行框架中,有效规避 VLM 推理延迟,提升代理主动性。大量实验表明,APEX 在具有挑战性的 UAV-ON 基准上相较先前最优方法,成功率提升 4.2%,路径长度占比(SPL)提升 2.8%,验证了其高效性与分层异步设计的有效性。源代码已开源于 GitHub。

原文摘要 · Abstract (English)

Aerial Object Goal Navigation, a challenging frontier in Embodied AI, requires an Unmanned Aerial Vehicle (UAV) agent to autonomously explore, reason, and identify a specific target using only visual perception and language description. However, existing methods struggle with the memorization of complex spatial representations in aerial environments, reliable and interpretable action decision-making, and inefficient exploration and information gathering. To address these challenges, we introduce \textbf{APEX} (Aerial Parallel Explorer), a novel hierarchical agent designed for efficient exploration and target acquisition in complex aerial settings. APEX is built upon a modular, three-part architecture: 1) Dynamic Spatio-Semantic Mapping Memory, which leverages the zero-shot capability of a Vision-Language Model (VLM) to dynamically construct high-resolution 3D Attraction, Exploration, and Obstacle maps, serving as an interpretable memory mechanism. 2) Action Decision Module, trained with reinforcement learning, which translates this rich spatial understanding into a fine-grained and robust control policy. 3) Target Grounding Module, which employs an open-vocabulary detector to achieve definitive and generalizable target identification. All these components are integrated into a hierarchical, asynchronous, and parallel framework, effectively bypassing the VLM's inference latency and boosting the agent's proactivity in exploration. Extensive experiments show that APEX outperforms the previous state of the art by +4.2\% SR and +2.8\% SPL on challenging UAV-ON benchmarks, demonstrating its superior efficiency and the effectiveness of its hierarchical asynchronous design. Our source code is provided in \href{https://github.com/4amGodvzx/apex}{GitHub}

无人机导航视觉语言模型强化学习分层决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。