arXiv:2603.06914cs.RO2026-03被引 5

多层级协作系统让机器人跨平台高效找物,真实场景表现卓越。

SysNav: Multi-Level Systematic Cooperation Enables Real-World, Cross-Embodiment Object Navigation

  • 分三层设计:语义理解、房间级规划、设备特异控制
  • 真实世界190次实验,成功率与效率显著提升
  • 适配轮式、四足、人形机器人,首次实现楼宇级长距导航

真实世界中的物体导航(ObjectNav)需应对复杂空间结构、长时程规划和语义理解等多重挑战。尽管视觉语言模型(VLMs)在语义理解方面展现潜力,但如何有效融入实际导航系统仍具难度。本文将真实世界物体导航视为系统级问题,提出多层级协同系统SysNav,支持跨设备部署。该系统将语义推理、导航规划与运动控制解耦,确保鲁棒性与泛化能力。高层通过结构化场景表示结合VLM提供语义引导;中层采用基于房间的分层导航策略,仅在房间级决策时调用VLM,兼顾推理能力与效率;底层则由适配不同机器人的运动控制模块执行规划路径。我们在三种设备上部署:自研轮式机器人、Unitree Go2四足机器人及Unitree G1人形机器人,完成190次真实世界实验。结果表明,系统在成功率达显著提升的同时,导航效率也大幅优化。据我们所知,SysNav是首个可在复杂真实环境中可靠、高效完成楼宇尺度长距离物体导航的系统。此外,在四个仿真基准上的广泛测试亦达到领先性能。

原文摘要 · Abstract (English)

Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent advances in Vision-Language Models (VLMs) offer promising capabilities for semantic understanding, yet effectively integrating them into real-world navigation systems remains a non-trivial challenge. In this work, we formulate real-world ObjectNav as a system-level problem and introduce SysNav, a three-level ObjectNav system designed for real-world crossembodiment deployment. SysNav decouples semantic reasoning, navigation planning and motion control to ensure robustness and generalizability. At the high-level, we summarize the environment into a structured scene representation and leverage VLMs to provide semantic-grounded navigation guidance. At the mid-level, we introduce a hierarchical room-based navigation strategy that reserves VLM guidance for room-level decisions, which effectively utilizes its reasoning ability while ensuring system efficiency. At the low-level, planned waypoints are executed through different embodiment-specific motion control modules. We deploy our system on three embodiments, a custom-built wheeled robot, the Unitree Go2 quadruped and the Unitree G1 humanoid, and conduct 190 real-world experiments. Our system achieves substantial improvements in both success rate and navigation efficiency. To the best of our knowledge, SysNav is the first system capable of reliably and efficiently completing building-scale long-range object navigation in complex real-world environments. Furthermore, extensive experiments on four simulation benchmarks demonstrate state-of-the-art performance. Project page is available at: https://cmu-vln.github.io/.

物体导航多智能体跨设备视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。