arXiv:2511.08935cs.ROcs.CV2025-11AAAI被引 5

用视觉前沿信息指导探索,让智能体更聪明地导航。

Expand Your SCOPE: Semantic Cognition over Potential-Based Exploration for Embodied Visual Navigation

  • 基于视觉前沿构建时空势能图,指导探索方向
  • 在两个任务上准确率提升4.6%,超越现有方法
  • 适合需要长期规划的机器人导航场景

具身视觉导航仍具挑战性,因智能体需在未知环境中以有限知识进行探索。现有零样本研究虽通过记忆机制支持目标导向行为,但忽视了视觉前缘边界对后续轨迹与观测的根本影响,且难以推断部分视觉观察与导航目标之间的关系。本文提出一种零样本框架——基于势能探索的语义认知(SCOPE),显式利用前缘信息驱动势能探索,实现更知情、更相关于目标的决策。SCOPE通过视觉语言模型估计探索势能,并将其组织为时空势能图,捕捉边界动态以支持长时程规划。此外,引入自反思机制,重新审视并优化先前决策,提升可靠性并减少过度自信错误。在两项多样化具身导航任务上的实验结果表明,SCOPE在准确率上比先进基线提升4.6%。进一步分析显示,其核心组件显著提升了校准能力、泛化性能和决策质量。

原文摘要 · Abstract (English)

Embodied visual navigation remains a challenging task, as agents must explore unknown environments with limited knowledge. Existing zero-shot studies have shown that incorporating memory mechanisms to support goal-directed behavior can improve long-horizon planning performance. However, they overlook visual frontier boundaries, which fundamentally dictate future trajectories and observations, and fall short of inferring the relationship between partial visual observations and navigation goals. In this paper, we propose Semantic Cognition Over Potential-based Exploration (SCOPE), a zero-shot framework that explicitly leverages frontier information to drive potential-based exploration, enabling more informed and goal-relevant decisions. SCOPE estimates exploration potential with a Vision-Language Model and organizes it into a spatio-temporal potential graph, capturing boundary dynamics to support long-horizon planning. In addition, SCOPE incorporates a self-reconsideration mechanism that revisits and refines prior decisions, enhancing reliability and reducing overconfident errors. Experimental results on two diverse embodied navigation tasks show that SCOPE outperforms state-of-the-art baselines by 4.6\% in accuracy. Further analysis demonstrates that its core components lead to improved calibration, stronger generalization, and higher decision quality.

具身导航视觉语言模型探索策略长程规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。