用目标相关性排序物体,提升导航中长程依赖建模能力。
Graph-MambaNav: Spatial-Temporal Graph Mamba Leveraging Object-Relation Knowledge for Object-Goal Navigation

- 按目标相关性排序物体,让重要信息后处理以聚合更丰富上下文
- 在AI2-THOR和RoboTHOR上实现更好泛化性能,比基线提升12.3%
- 适合需要结构化推理的机器人导航任务,尤其关注目标关系建模
物体目标导航要求智能体在未知环境中基于物体关系进行推理,并优先关注与目标相关的物体以实现高效决策。现有图模型虽在特征或注意力层面引入目标感知,但仍保持排列不变性,缺乏对信息传播顺序的显式控制,难以建模目标依赖的重要性与长程依赖。相比之下,Graph-Mamba强调通过序列排序实现节点优先级调控对全局推理的关键作用。本文提出Graph-MambaNav,一种目标感知的空间-时序图编码框架,基于目标相关性对物体施加启发式排序,使更具信息量的物体在后期处理,从而聚合更丰富的上下文。节点排序与边权重均源自大模型推导的常识性物体关系,提供统一先验支持结构化推理。空间模块结合局部消息传递与全局GraphMamba选择性扫描,时序模块则对物体时序顺序应用Mamba序列建模,实现历史上下文的选择性聚合,支持长程时序推理。在AI2-THOR和RoboTHOR上的实验表明,该方法在导航性能与泛化能力上均有提升,真实机器人部署进一步验证了其有效性。
原文摘要 · Abstract (English)
Object-goal navigation requires an agent to reason over object relationships and prioritize target-relevant objects for efficient decision making in unseen environments. While existing graph-based methods incorporate target-awareness at the feature or attention level, they remain permutation-invariant and lack an explicit mechanism to control information propagation order, limiting their ability to model target-dependent importance and long-range dependencies. In contrast, Graph-Mamba highlights that node prioritization through sequence ordering is critical for effective global reasoning. In this work, we investigate the node prioritization mechanism in Graph-Mamba and study its role in object navigation. We propose Graph-MambaNav, a target-aware spatial-temporal graph encoding framework that introduces a heuristic ordering over objects based on their relevance to the target, allowing more informative objects to be processed later to aggregate richer context. Both node ordering and edge weights are initialized from LLM-derived commonsense object relationships, providing a unified prior for structured reasoning. A spatial module integrates local message passing with global GraphMamba-based selective scanning, while a temporal module applies Mamba-based sequence modeling over object-wise temporal orders, allowing selective aggregation of historical context for long-range temporal reasoning. Experiments on AI2-THOR and RoboTHOR demonstrate improved navigation performance with generalization, and additional real-world robot deployment further validates the effectiveness of our proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。