arXiv:2503.10630cs.CVcs.RO2025-03CVPR被引 105

统一目标表示,让模型零样本通用导航,一模型通吃多种任务。

UniGoal: Towards Universal Zero-shot Goal-oriented Navigation

论文配图:UniGoal: Towards Universal Zero-shot Goal-oriented Navigation
图 1 · 摘自论文原文
  • 用统一图结构表示不同目标,兼容类别、图像和文本描述。
  • 实时构建场景图,通过图匹配分阶段引导智能体寻址,精度领先。
  • 适合跨任务零样本导航研究者,尤其关注通用性与推理机制的场景。

本文提出一种通用零样本目标导向导航框架——UniGoal。现有零样本方法依赖大语言模型(LLM)针对特定任务构建推理流程,各任务间架构差异大,难以跨类型泛化。为实现通用零样本导航,我们设计统一图表示来统一物体类别、实例图像及文本描述等不同类型的目标,并将智能体观测动态构建为在线维护的场景图。基于一致的场景与目标表示,相比纯文本保留更多结构信息,可有效利用LLM进行显式的图推理。具体而言,在每个时间步执行场景图与目标图的图匹配:零匹配时迭代搜索目标子图;部分匹配时使用坐标投影与锚点对齐推断目标位置;最终通过场景图修正与目标验证实现完全匹配。此外引入黑名单机制实现各阶段鲁棒切换。在多个基准上的大量实验表明,UniGoal仅用单一模型即在三个导航任务中达到当前最优零样本性能,甚至超越特定任务的零样本方法与监督型通用方法。

原文摘要 · Abstract (English)

In this paper, we propose a general framework for universal zero-shot goal-oriented navigation. Existing zero-shot methods build inference framework upon large language models (LLM) for specific tasks, which differs a lot in overall pipeline and fails to generalize across different types of goal. Towards the aim of universal zero-shot navigation, we propose a uniform graph representation to unify different goals, including object category, instance image and text description. We also convert the observation of agent into an online maintained scene graph. With this consistent scene and goal representation, we preserve most structural information compared with pure text and are able to leverage LLM for explicit graph-based reasoning. Specifically, we conduct graph matching between the scene graph and goal graph at each time instant and propose different strategies to generate long-term goal of exploration according to different matching states. The agent first iteratively searches subgraph of goal when zero-matched. With partial matching, the agent then utilizes coordinate projection and anchor pair alignment to infer the goal location. Finally scene graph correction and goal verification are applied for perfect matching. We also present a blacklist mechanism to enable robust switch between stages. Extensive experiments on several benchmarks show that our UniGoal achieves state-of-the-art zero-shot performance on three studied navigation tasks with a single model, even outperforming task-specific zero-shot methods and supervised universal methods.

零样本导航图神经网络通用智能体多模态理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。