提出跨楼层零样本物体导航新方法,让机器人在未见过的多层环境中精准找物。
Multi-Floor Zero-Shot Object Navigation Policy
- 分层导航策略结合大模型推理,实现跨楼层探索与决策
- 在HM3D和MP3D数据集上零样本成功率显著领先现有方法
- 真实四足机器人验证可行,适用于复杂真实多层场景
多楼层环境中的物体导航是机器人领域的重大挑战,需要复杂的空间推理与自适应探索策略。传统方法主要聚焦单层场景,忽视了多层结构带来的复杂性。为此,我们提出多楼层导航策略(MFNP),并应用于零样本物体导航任务。框架包含三个核心组件:(i) 多楼层导航策略,使智能体可在多层间探索;(ii) 多模态大语言模型(MLLM)用于导航过程中的推理;(iii) 跨楼层导航机制,确保楼层间高效转移。我们在Habitat-Matterport 3D(HM3D)和Matterport 3D(MP3D)数据集上评估,两者均包含多层场景。实验结果表明,MFNP在零样本物体导航中显著优于现有方法,成功率更高,探索效率更优。消融实验证明各组件对解决多层导航独特挑战的有效性。此外,我们进行了真实世界实验,部署后,Unitree四足机器人成功在完全未见过的环境中完成多层导航并找到目标物体。通过引入MFNP,我们为复杂多层环境下的物体导航任务提供了新范式,拓展了视觉导航在真实多层场景中的研究前景。
原文摘要 · Abstract (English)
Object navigation in multi-floor environments presents a formidable challenge in robotics, requiring sophisticated spatial reasoning and adaptive exploration strategies. Traditional approaches have primarily focused on single-floor scenarios, overlooking the complexities introduced by multi-floor structures. To address these challenges, we first propose a Multi-floor Navigation Policy (MFNP) and implement it in Zero-Shot object navigation tasks. Our framework comprises three key components: (i) Multi-floor Navigation Policy, which enables an agent to explore across multiple floors; (ii) Multi-modal Large Language Models (MLLMs) for reasoning in the navigation process; and (iii) Inter-Floor Navigation, ensuring efficient floor transitions. We evaluate MFNP on the Habitat-Matterport 3D (HM3D) and Matterport 3D (MP3D) datasets, both include multi-floor scenes. Our experiment results demonstrate that MFNP significantly outperforms all the existing methods in Zero-Shot object navigation, achieving higher success rates and improved exploration efficiency. Ablation studies further highlight the effectiveness of each component in addressing the unique challenges of multi-floor navigation. Meanwhile, we conducted real-world experiments to evaluate the feasibility of our policy. Upon deployment of MFNP, the Unitree quadruped robot demonstrated successful multi-floor navigation and found the target object in a completely unseen environment. By introducing MFNP, we offer a new paradigm for tackling complex, multi-floor environments in object navigation tasks, opening avenues for future research in visual-based navigation in realistic, multi-floor settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。