无需相机位姿先验,通过局部到全局优化提升NeRF重建质量
NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior
- 先通过特征匹配初始化相对位姿,再进行局部联合优化提升位姿精度
- 引入束调整机制,结合几何一致性约束,显著改善相机位姿与视图合成效果
- 首个融合局部与全局信息的NeRF优化方法,适合复杂场景重建任务
本文提出NoPe-NeRF++,一种无需相机位姿先验的NeRF局部到全局优化算法。现有方法如NoPe-NeRF仅依赖图像内局部关系,在复杂场景中常难以准确恢复相机位姿。为此,我们首先通过显式特征匹配进行相对位姿初始化,随后执行局部联合优化以增强位姿估计,显著提升初始位姿质量。进一步引入全局优化阶段,利用束调整(bundle adjustment)结合几何一致性约束,整合特征轨迹以精炼位姿,共同提升NeRF重建质量。该方法首次无缝融合局部与全局线索,显著优于当前最优方法,在多个基准数据集上的评估显示其在位姿估计精度和新视角合成方面均具更强性能与鲁棒性,尤其在挑战性场景下表现突出。
原文摘要 · Abstract (English)
In this paper, we introduce NoPe-NeRF++, a novel local-to-global optimization algorithm for training Neural Radiance Fields (NeRF) without requiring pose priors. Existing methods, particularly NoPe-NeRF, which focus solely on the local relationships within images, often struggle to recover accurate camera poses in complex scenarios. To overcome the challenges, our approach begins with a relative pose initialization with explicit feature matching, followed by a local joint optimization to enhance the pose estimation for training a more robust NeRF representation. This method significantly improves the quality of initial poses. Additionally, we introduce global optimization phase that incorporates geometric consistency constraints through bundle adjustment, which integrates feature trajectories to further refine poses and collectively boost the quality of NeRF. Notably, our method is the first work that seamlessly combines the local and global cues with NeRF, and outperforms state-of-the-art methods in both pose estimation accuracy and novel view synthesis. Extensive evaluations on benchmark datasets demonstrate our superior performance and robustness, even in challenging scenes, thus validating our design choices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。