arXiv:2409.11764cs.ROcs.AI2024-09ICRA被引 24

让机器人通过一张地图持续学习,快速找多个没见过的物体。

One Map to Find Them All: Real-time Open-Vocabulary Mapping for Zero-shot Multi-Object Navigation

  • 构建可复用的开放词汇特征地图,支持实时物体搜索。
  • 通过概率语义更新减少误检,提升地图准确性。
  • 适合需要连续查找多个新物体的现实机器人场景。

高效搜索复杂环境中的物体是众多实际机器人应用的基础。近年来,开放词汇视觉模型推动了语义感知的零样本物体导航方法,使机器人可在未训练的情况下搜索任意物体。然而,现有零样本方法在每次查询时均将环境视为未知。本文提出新的零样本多物体导航基准,允许机器人利用先前搜索的信息来更高效地定位新物体。为此,我们构建了一个专为实时物体搜索设计的可复用开放词汇特征地图,并提出一种概率语义地图更新机制,以缓解语义特征提取中的常见误差,同时利用语义不确定性指导多物体探索。我们在仿真和真实机器人上评估了该方法,实验使用 Jetson Orin AGX 实现实时运行。结果表明,该方法在单物体与多物体导航任务中均优于现有最先进方法。更多视频、代码及多物体导航基准已公开于 https://finnbsch.github.io/OneMap。

原文摘要 · Abstract (English)

The capability to efficiently search for objects in complex environments is fundamental for many real-world robot applications. Recent advances in open-vocabulary vision models have resulted in semantically-informed object navigation methods that allow a robot to search for an arbitrary object without prior training. However, these zero-shot methods have so far treated the environment as unknown for each consecutive query. In this paper we introduce a new benchmark for zero-shot multi-object navigation, allowing the robot to leverage information gathered from previous searches to more efficiently find new objects. To address this problem we build a reusable open-vocabulary feature map tailored for real-time object search. We further propose a probabilistic-semantic map update that mitigates common sources of errors in semantic feature extraction and leverage this semantic uncertainty for informed multi-object exploration. We evaluate our method on a set of object navigation tasks in both simulation as well as with a real robot, running in real-time on a Jetson Orin AGX. We demonstrate that it outperforms existing state-of-the-art approaches both on single and multi-object navigation tasks. Additional videos, code and the multi-object navigation benchmark will be available on https://finnbsch.github.io/OneMap.

机器人导航零样本开放词汇实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。