arXiv:2509.09594cs.ROcs.AI2025-09被引 6

用物体相对关系指导视觉导航,提升跨场景泛化能力。

ObjectReact: Learning Object-Relative Control for Visual Navigation

  • 构建物体级全局路径成本图,实现物体相对控制
  • 在不同高度和反向路径任务中表现优于传统图像相对方法
  • 仅在仿真训练即可良好适配真实室内环境,适合实际部署

仅使用单目相机和拓扑地图的视觉导航近年来成为替代需额外传感器与三维地图方法的有吸引力方案。传统方法依赖“图像相对”策略,通过当前观测与目标图像对估计控制,但图像表示受限于智能体姿态与本体。相比之下,物体作为地图属性,具备本体与轨迹无关的特性。本文提出“物体相对”控制新范式,具有三大优势:1)无需严格模仿过往经验即可探索新路径;2)控制预测可解耦于图像匹配问题;3)在跨本体部署中对训练-测试及建图-执行差异均具高鲁棒性。我们提出一种“相对”3D场景图形式的拓扑度量地图,用于生成更丰富的物体级全局路径规划成本。训练一个名为ObjectReact的局部控制器,直接基于高层“目标物体成本图”进行决策,无需显式RGB输入。实验表明,在传感器高度变化和反向路径等挑战性任务中,该方法显著优于图像相对基线。进一步验证了仅在仿真训练的策略可在真实室内环境中良好泛化。代码与补充材料见项目页:https://object-react.github.io/

原文摘要 · Abstract (English)

Visual navigation using only a single camera and a topological map has recently become an appealing alternative to methods that require additional sensors and 3D maps. This is typically achieved through an "image-relative" approach to estimating control from a given pair of current observation and subgoal image. However, image-level representations of the world have limitations because images are strictly tied to the agent's pose and embodiment. In contrast, objects, being a property of the map, offer an embodiment- and trajectory-invariant world representation. In this work, we present a new paradigm of learning "object-relative" control that exhibits several desirable characteristics: a) new routes can be traversed without strictly requiring to imitate prior experience, b) the control prediction problem can be decoupled from solving the image matching problem, and c) high invariance can be achieved in cross-embodiment deployment for variations across both training-testing and mapping-execution settings. We propose a topometric map representation in the form of a "relative" 3D scene graph, which is used to obtain more informative object-level global path planning costs. We train a local controller, dubbed "ObjectReact", conditioned directly on a high-level "WayObject Costmap" representation that eliminates the need for an explicit RGB input. We demonstrate the advantages of learning object-relative control over its image-relative counterpart across sensor height variations and multiple navigation tasks that challenge the underlying spatial understanding capability, e.g., navigating a map trajectory in the reverse direction. We further show that our sim-only policy is able to generalize well to real-world indoor environments. Code and supplementary material are accessible via project page: https://object-react.github.io/

视觉导航物体相对跨域泛化仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。