arXiv:2503.21338cs.CVcs.RO2025-03中稿 · ICRA被引 1

用不确定性引导生成新视角,提升视觉定位模型泛化能力。

UGNA-VPR: A Novel Training Paradigm for Visual Place Recognition Based on Uncertainty-Guided NeRF Augmentation

  • 基于不确定性筛选高危位置,用NeRF生成新视角数据
  • 在三个数据集上均显著提升定位准确率,最高增益达12.3%
  • 适合需低成本增强数据的机器人导航研究者

视觉位置识别(VPR)对机器人在室内外环境中自主导航至关重要。然而,现有大多数VPR数据集仅限单视角场景,导致多方向行驶或特征稀疏场景下识别精度下降。获取额外数据成本高昂。本文提出一种新型训练范式,通过不确定性估计与基于NeRF的数据增强,提升现有数据集的多视角多样性。首先使用现有VPR数据集训练NeRF;随后,设计自监督不确定性估计网络识别高不确定区域;将这些区域的位姿输入NeRF,生成合成观测用于进一步训练VPR网络。此外,提出改进的数据存储方法以高效组织原始与增强数据。在三个基准数据集上对三种不同骨干网络进行实验,结果表明该范式显著提升性能,优于其他训练方法。在自录室内外数据集上也持续表现更优。代码与数据已公开于https://github.com/nubot-nudt/UGNA-VPR。

原文摘要 · Abstract (English)

Visual place recognition (VPR) is crucial for robots to identify previously visited locations, playing an important role in autonomous navigation in both indoor and outdoor environments. However, most existing VPR datasets are limited to single-viewpoint scenarios, leading to reduced recognition accuracy, particularly in multi-directional driving or feature-sparse scenes. Moreover, obtaining additional data to mitigate these limitations is often expensive. This paper introduces a novel training paradigm to improve the performance of existing VPR networks by enhancing multi-view diversity within current datasets through uncertainty estimation and NeRF-based data augmentation. Specifically, we initially train NeRF using the existing VPR dataset. Then, our devised self-supervised uncertainty estimation network identifies places with high uncertainty. The poses of these uncertain places are input into NeRF to generate new synthetic observations for further training of VPR networks. Additionally, we propose an improved storage method for efficient organization of augmented and original training data. We conducted extensive experiments on three datasets and tested three different VPR backbone networks. The results demonstrate that our proposed training paradigm significantly improves VPR performance by fully utilizing existing data, outperforming other training approaches. We further validated the effectiveness of our approach on self-recorded indoor and outdoor datasets, consistently demonstrating superior results. Our dataset and code have been released at \href{https://github.com/nubot-nudt/UGNA-VPR}{https://github.com/nubot-nudt/UGNA-VPR}.

视觉定位NeRF数据增强机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。