解决零样本导航中目标追踪不连贯问题,提升寻物成功率
ConsistNav: Closing the Action Consistency Gap in Zero-Shot Object Navigation with Semantic Executive Control

- 用语义执行器分阶段控制探索与追击,保持目标一致性
- 在MP3D上成功率达11.4%提升,路径相似度提高7.9%
- 无需训练,可适配现有检测与规划模块,适合实际部署
零样本目标导航虽借助开放词汇检测器、图文模型和语言引导探索取得进展,但即便识别出合理目标,智能体仍可能在探索与追击间反复震荡,或在接近成功时放弃。我们将其归因于动作一致性缺口:语义证据在每一步被重复解读,缺乏跨步骤的持续承诺。为此提出ConsistNav,一种无需训练的零样本目标导航框架,核心为由三个模块协同的语义执行器:有限状态执行控制器通过受保护的语义阶段推进目标追踪;持久候选记忆将跨帧目标证据整合为稳定假设;稳定性感知动作控制抑制旋转停滞、无效追击及未验证停止。该设计不修改检测器或底层规划器,仅控制语义证据何时影响导航、何时应被抑制或重审。在HM3D和MP3D上广泛实验表明,ConsistNav在对比方法中达到最先进水平,在MP3D上相较基线提升成功率11.4%、路径相似度7.9%。消融研究与真实场景部署进一步验证了该执行机制的有效性与鲁棒性。
原文摘要 · Abstract (English)
Zero-shot object navigation has advanced rapidly with open-vocabulary detectors, image--text models, and language-guided exploration. However, even after current methods detect a plausible target hypothesis, the agent may still oscillate between exploration and pursuit, or abandon the object near success. We identify this failure mode as an action consistency gap: semantic evidence is repeatedly reinterpreted at each step without persistent commitment across the episode. We introduce ConsistNav, a training-free zero-shot ObjectNav framework built around a semantic executive composed of three coordinated modules: Finite-State Executive Controller stages target pursuit through guarded semantic phases; Persistent Candidate Memory accumulates cross-frame target evidence into stable object hypotheses; and Stability-Aware Action Control suppresses rotational stagnation, ineffective pursuit, and unverified stopping. This design changes neither the detector nor the low-level planner; instead, it controls when semantic evidence should influence navigation and when it should be suppressed or revisited. We conduct extensive experiments on HM3D and MP3D, where ConsistNav achieves state-of-the-art results among compared zero-shot ObjectNav methods and improves SR by 11.4% and SPL by 7.9% over the controlled baseline on MP3D. Ablation studies and real-world deployment experiments further demonstrate the effectiveness and robustness of the proposed executive mechanism.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。