arXiv:2503.06117cs.CV2025-03ICRA被引 7

用神经隐式地图实现高效视觉定位,速度更快存储更少。

NeuraLoc: Visual Localization in Neural Implicit Map with Dual Complementary Features

  • 通过隐式学习3D关键点描述子场,避免显式存储特征。
  • 训练速度提升3倍,模型存储减少45倍,定位精度更高。
  • 适合需要低存储高效率的实时视觉定位场景。

近期,神经辐射场(NeRF)在视觉定位领域受到广泛关注。然而,现有基于NeRF的方法或缺乏几何约束,或需大量存储进行特征匹配,限制了实际应用。为此,我们提出一种基于神经隐式地图的高效新颖视觉定位方法。为施加几何约束并降低存储需求,我们隐式学习一个3D关键点描述子场,无需显式存储逐点特征。为缓解描述子的语义模糊性,引入额外的语义上下文特征场,提升2D-3D对应关系的质量与可靠性。此外,提出描述子相似度分布对齐,以缩小匹配过程中2D与3D特征空间的域差距。最终,结合互补描述子与上下文特征构建匹配图,实现精确的2D-3D对应关系,用于6-DoF位姿估计。相较于近期基于NeRF的方法,本方法训练速度提升3倍,模型存储减少45倍。在两个常用数据集上的大量实验表明,本方法性能优于或媲美当前最先进方法。

原文摘要 · Abstract (English)

Recently, neural radiance fields (NeRF) have gained significant attention in the field of visual localization. However, existing NeRF-based approaches either lack geometric constraints or require extensive storage for feature matching, limiting their practical applications. To address these challenges, we propose an efficient and novel visual localization approach based on the neural implicit map with complementary features. Specifically, to enforce geometric constraints and reduce storage requirements, we implicitly learn a 3D keypoint descriptor field, avoiding the need to explicitly store point-wise features. To further address the semantic ambiguity of descriptors, we introduce additional semantic contextual feature fields, which enhance the quality and reliability of 2D-3D correspondences. Besides, we propose descriptor similarity distribution alignment to minimize the domain gap between 2D and 3D feature spaces during matching. Finally, we construct the matching graph using both complementary descriptors and contextual features to establish accurate 2D-3D correspondences for 6-DoF pose estimation. Compared with the recent NeRF-based approaches, our method achieves a 3$\times$ faster training speed and a 45$\times$ reduction in model storage. Extensive experiments on two widely used datasets demonstrate that our approach outperforms or is highly competitive with other state-of-the-art NeRF-based visual localization methods. Project page: \href{https://zju3dv.github.io/neuraloc}{https://zju3dv.github.io/neuraloc}

视觉定位神经隐式高效建模6-DoF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。