用思维树框架让机器人零样本导航未知物体,听懂复杂指令
Zero-shot Object Navigation with Vision-Language Models Reasoning
- 引入思维树推理框架,动态规划探索路径
- 在PASTURE和RoboTHOR上实现领先性能
- 适合需要自然语言导航的智能机器人场景
目标导航对机器人至关重要,但传统方法需大量训练数据且无法泛化至未知环境。零样本目标导航(ZSON)旨在解决此问题,使机器人无需特定训练即可与未知物体交互。语言驱动的零样本目标导航(L-ZSON)通过自然语言指令引导机器人导航与物体交互。本文提出一种新型视觉语言模型VLTNet,包含四个模块:视觉语言理解、语义建图、思维树推理与探索、目标识别。其中,思维树(ToT)推理与探索模块为核心,创新性地将ToT推理框架用于机器人探索前沿的选择。相比无推理的传统前沿选择,基于ToT的导航通过多路径推理与必要回溯,实现全局知情决策,精度更高。在PASTURE和RoboTHOR基准上的实验表明,该模型在复杂自然语言指令场景下的L-ZSON任务中表现卓越。
原文摘要 · Abstract (English)
Object navigation is crucial for robots, but traditional methods require substantial training data and cannot be generalized to unknown environments. Zero-shot object navigation (ZSON) aims to address this challenge, allowing robots to interact with unknown objects without specific training data. Language-driven zero-shot object navigation (L-ZSON) is an extension of ZSON that incorporates natural language instructions to guide robot navigation and interaction with objects. In this paper, we propose a novel Vision Language model with a Tree-of-thought Network (VLTNet) for L-ZSON. VLTNet comprises four main modules: vision language model understanding, semantic mapping, tree-of-thought reasoning and exploration, and goal identification. Among these modules, Tree-of-Thought (ToT) reasoning and exploration module serves as a core component, innovatively using the ToT reasoning framework for navigation frontier selection during robot exploration. Compared to conventional frontier selection without reasoning, navigation using ToT reasoning involves multi-path reasoning processes and backtracking when necessary, enabling globally informed decision-making with higher accuracy. Experimental results on PASTURE and RoboTHOR benchmarks demonstrate the outstanding performance of our model in LZSON, particularly in scenarios involving complex natural language as target instructions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。