让机器人在有限算力下实现高效导航与复杂推理
A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration

- 分层设计:感知层快速响应,推理层异步深度思考
- 构建紧凑记忆图,逐步输入视觉语言模型提升长程规划能力
- 将探索建模为加权旅行维修员问题,兼顾智能与效率
将具身智能与嵌入式部署结合仍是智能机器人系统的关键挑战,需在计算、内存、能耗和实时性约束下完成感知、推理与规划。在视觉语言导航(VLN)中,现有方法常在推理能力与部署效率间权衡。本文提出一个可部署的具身VLN系统,在真实机器人上同时实现高效率与强高层推理。系统分为快速感知-动作层与深层推理层,异步运行于不同时间尺度,并通过共享记忆层高效交互。为支持长时程推理,系统增量构建紧凑记忆图,并逐步将分解子图输入视觉语言模型(VLM)。此外,将探索建模为加权旅行维修员问题(WTRP),综合考虑推理结果与候选区域的空间分布。仿真与真实环境中的大量实验表明,该系统在资源受限硬件上保持实时性能的同时,导航成功率与效率均优于现有方法。代码及更多真实实验见 https://github.com/xukuanHIT/HiCo-Nav。
原文摘要 · Abstract (English)
Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy, and real-time execution. In vision-and-language navigation (VLN), existing approaches often face a trade-off between reasoning capability and deployment efficiency on real-world platforms. In this paper, we present a deployable embodied VLN system that achieves both high efficiency and strong high-level reasoning on real-world robots. The system is decomposed into a fast perception-action layer and a deep reasoning layer running asynchronously at different time scales, with a shared memory layer enabling efficient interaction between them. To support long-horizon reasoning, we incrementally construct a compact memory graph and progressively feed decomposed subgraphs into a vision-language model (VLM). Furthermore, we formulate exploration as a Weighted Traveling Repairman Problem (WTRP) by jointly considering reasoning outcomes and the spatial distribution of candidate regions. Extensive experiments in simulation and real-world environments demonstrate improved navigation success and efficiency over existing VLN approaches while maintaining real-time performance on resource-constrained hardware. Code and additional real-world experiments are available at https://github.com/xukuanHIT/HiCo-Nav.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。