arXiv:2512.15080cs.RO2025-12

用NeRF辅助3D点对齐,提升自动驾驶定位精度。

NAP3D: NeRF Assisted 3D-3D Pose Alignment for Autonomous Vehicles

  • 直接对齐观测点与NeRF合成点,实现3D-3D pose对齐
  • 在自定义数据集上定位误差小于5厘米,优于2D-3D方法
  • 无需重访旧位置,适合无环闭合场景的轻量级补救

精准定位对自动驾驶至关重要,但传感器噪声和长时间漂移会导致显著的位姿估计误差,尤其在长时程环境中。传统方案依赖视觉环闭合进行位姿图修正,需识别当前视图与历史场景间的视觉对应关系,并常融合多传感器数据。本文提出一种互补性方法——基于NeRF的3D-3D位姿对齐(NAP3D),利用当前深度图像与预训练神经辐射场(NeRF)之间的3D-3D对应关系,直接将观测场景的3D点与NeRF生成的合成点对齐,从而在新视角下也能精修位姿,无需重访已知位置。该方法相比传统2D-3D定位更具鲁棒性,且在精度与适用性上相当。实验表明,在自定义数据集上,NAP3D实现小于5厘米的相机位姿校正;在TUM RGB-D数据集上,尽管PnP在某些条件下原始旋转和平移误差更低,但NAP3D仍能持续提升3D对齐均方根误差约6厘米,体现其在三维空间中的更好几何一致性。NAP3D作为轻量、数据无关的工具,可有效补充无法使用传统环闭合的现有SLAM与定位流程。

原文摘要 · Abstract (English)

Accurate localization is essential for autonomous vehicles, yet sensor noise and drift over time can lead to significant pose estimation errors, particularly in long-horizon environments. A common strategy for correcting accumulated error is visual loop closure in SLAM, which adjusts the pose graph when the agent revisits previously mapped locations. These techniques typically rely on identifying visual mappings between the current view and previously observed scenes and often require fusing data from multiple sensors. In contrast, this work introduces NeRF-Assisted 3D-3D Pose Alignment (NAP3D), a complementary approach that leverages 3D-3D correspondences between the agent's current depth image and a pre-trained Neural Radiance Field (NeRF). By directly aligning 3D points from the observed scene with synthesized points from the NeRF, NAP3D refines the estimated pose even from novel viewpoints, without relying on revisiting previously observed locations. This robust 3D-3D formulation provides advantages over conventional 2D-3D localization methods while remaining comparable in accuracy and applicability. Experiments demonstrate that NAP3D achieves camera pose correction within 5 cm on a custom dataset, robustly outperforming a 2D-3D Perspective-N-Point baseline. On TUM RGB-D, NAP3D consistently improves 3D alignment RMSE by approximately 6 cm compared to this baseline given varying noise, despite PnP achieving lower raw rotation and translation parameter error in some regimes, highlighting NAP3D's improved geometric consistency in 3D space. By providing a lightweight, dataset-agnostic tool, NAP3D complements existing SLAM and localization pipelines when traditional loop closure is unavailable.

自动驾驶位姿估计NeRFSLAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。