arXiv:2604.04108cs.CV2026-04

让机器人导航时能自我纠错,避免错误信息累积。

Hypothesis Graph Refinement: Hypothesis-Driven Exploration with Cascade Error Correction for Embodied Navigation

  • 用可修正的假设节点构建依赖感知的图记忆,指导探索。
  • 实测在GOAT-Bench上达72.41%成功率,错误区域重访减少4.5倍。
  • 适合长期自主导航与多模态问答场景,尤其对误判敏感任务有效。

具身智能体需在部分观测环境中探索并维持可靠的长程记忆。现有基于图的导航系统虽提升可扩展性,但常将未探索区域视为语义未知,导致寻边效率低下。尽管视觉语言模型(VLMs)可预测前沿语义,但错误预测会嵌入记忆并随下游推理传播,引发结构化误差积累,仅靠置信度衰减无法解决。为此,我们提出假设图精炼(HGR)框架,将前沿预测表示为可修订的假设节点,构建依赖感知的图记忆。HGR包含:(1) 语义假设模块,根据上下文估计前沿语义分布,按目标相关性、旅行成本和不确定性排序探索目标;(2) 验证驱动的级联纠错机制,将现场观察与预测语义对比,一旦不匹配即回溯被驳回节点及其所有下游依赖。与累加式地图构建不同,该机制允许图通过修剪错误子图实现收缩,保障长周期内记忆可靠性。我们在多模态终身导航(GOAT-Bench)和具身问答(A-EQA, EM-EQA)上评估,HGR在GOAT-Bench上取得72.41%成功率和56.22% SPL,且在两个问答基准上均表现持续提升。诊断分析显示,级联纠错消除了约20%的冗余假设节点,错误区域重访减少4.5倍,镜面与透明表面导致67%的预测错误。

原文摘要 · Abstract (English)

Embodied agents must explore partially observed environments while maintaining reliable long-horizon memory. Existing graph-based navigation systems improve scalability, but they often treat unexplored regions as semantically unknown, leading to inefficient frontier search. Although vision-language models (VLMs) can predict frontier semantics, erroneous predictions may be embedded into memory and propagate through downstream inferences, causing structural error accumulation that confidence attenuation alone cannot resolve. These observations call for a framework that can leverage semantic predictions for directed exploration while systematically retracting errors once new evidence contradicts them. We propose Hypothesis Graph Refinement (HGR), a framework that represents frontier predictions as revisable hypothesis nodes in a dependency-aware graph memory. HGR introduces (1) semantic hypothesis module, which estimates context-conditioned semantic distributions over frontiers and ranks exploration targets by goal relevance, travel cost, and uncertainty, and (2) verification-driven cascade correction, which compares on-site observations against predicted semantics and, upon mismatch, retracts the refuted node together with all its downstream dependents. Unlike additive map-building, this allows the graph to contract by pruning erroneous subgraphs, keeping memory reliable throughout long episodes. We evaluate HGR on multimodal lifelong navigation (GOAT-Bench) and embodied question answering (A-EQA, EM-EQA). HGR achieves 72.41% success rate and 56.22% SPL on GOAT-Bench, and shows consistent improvements on both QA benchmarks. Diagnostic analysis reveals that cascade correction eliminates approximately 20% of structurally redundant hypothesis nodes and reduces revisits to erroneous regions by 4.5x, with specular and transparent surfaces accounting for 67% of corrected prediction errors.

具身导航图神经网络自我纠错多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。