arXiv:2411.03487cs.RO2024-11被引 2

用神经辐射场的不确定性提升机器人在未知环境中的探索能力。

Enhancing Exploratory Capability of Visual Navigation Using Uncertainty of Implicit Scene Representation

  • 基于隐式场景表示NeRF,通过估计其不确定性引导探索行为。
  • 实验表明该方法在图像目标导航任务中显著增强探索能力。
  • 适合需要在线构建认知地图的自主导航系统研究者参考。

在未知场景的视觉导航中,探索与利用同等重要。机器人需先通过探索建立环境认知,再利用认知信息寻找目标。然而,现有图像目标导航方法多侧重于目标搜索,忽视探索行为生成。为此,我们提出不确定性驱动探索的导航框架(NUE),以紧凑的隐式场景表示NeRF作为认知结构,通过估计其不确定性来增强探索能力,并反向促进隐式表示的构建。同时,从NeRF中提取记忆信息,提升机器人对目标位置的推理能力。最终,将两种能力无缝融合生成导航动作。该框架端到端运行,环境认知结构在线构建。大量实验表明,该方法能显著增强探索行为,并实现探索到利用的自然过渡,在图像目标导航任务中优于现有基于记忆的认知导航结构。

原文摘要 · Abstract (English)

In the context of visual navigation in unknown scenes, both "exploration" and "exploitation" are equally crucial. Robots must first establish environmental cognition through exploration and then utilize the cognitive information to accomplish target searches. However, most existing methods for image-goal navigation prioritize target search over the generation of exploratory behavior. To address this, we propose the Navigation with Uncertainty-driven Exploration (NUE) pipeline, which uses an implicit and compact scene representation, NeRF, as a cognitive structure. We estimate the uncertainty of NeRF and augment the exploratory ability by the uncertainty to in turn facilitate the construction of implicit representation. Simultaneously, we extract memory information from NeRF to enhance the robot's reasoning ability for determining the location of the target. Ultimately, we seamlessly combine the two generated abilities to produce navigational actions. Our pipeline is end-to-end, with the environmental cognitive structure being constructed online. Extensive experimental results on image-goal navigation demonstrate the capability of our pipeline to enhance exploratory behaviors, while also enabling a natural transition from the exploration to exploitation phase. This enables our model to outperform existing memory-based cognitive navigation structures in terms of navigation performance.

视觉导航隐式表示不确定性建模自主探索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。