用3D重建+启发式优化,提升相机定位精度
HGSLoc: 3DGS-based Heuristic Camera Pose Refinement
- 基于3DGS构建几何地图,生成高质量合成视图
- 在7Scenes等数据集上优于基于NeRF的方法
- 轻量级插件设计,适合实时定位场景
视觉定位旨在已知场景中确定相机位姿与朝向。受光照变化和视角差异影响,该任务常面临挑战。本文提出HGSLoc,一种轻量级即插即用的位姿优化框架,融合3D重建与启发式精修策略,实现更高精度的位姿估计。通过显式几何地图与高保真渲染,生成高质量合成视图以支持定位。方法在7Scenes和Deep Blending数据集上表现优于基于NeRF的神经渲染定位方法。引入启发式精修策略,可快速定位目标节点,设置步长优化机制进一步提升小误差场景下的精度。通过精心设计的启发函数,实现高效优化,显著降低粗略估计的误差。该方法减少对复杂神经网络的依赖,在噪声干扰和复杂环境中的鲁棒性更强,且优于联合优化策略。代码已开源:https://github.com/anchang699/HGSLoc。
原文摘要 · Abstract (English)
Visual localization refers to the process of determining camera poses and orientation within a known scene representation. This task is often complicated by factors such as changes in illumination and variations in viewing angles. In this paper, we propose HGSLoc, a novel lightweight plug-and-play pose optimization framework, which integrates 3D reconstruction with a heuristic refinement strategy to achieve higher pose estimation accuracy. Specifically, we introduce an explicit geometric map for 3D representation and high-fidelity rendering, allowing the generation of high-quality synthesized views to support accurate visual localization. Our method demonstrates higher localization accuracy compared to NeRF-based neural rendering localization approaches. We introduce a heuristic refinement strategy, its efficient optimization capability can quickly locate the target node, while we set the step level optimization step to enhance the pose accuracy in the scenarios with small errors. With carefully designed heuristic functions, it offers efficient optimization capabilities, enabling rapid error reduction in rough localization estimations. Our method mitigates the dependence on complex neural network models while demonstrating improved robustness against noise and higher localization accuracy in challenging environments, as compared to neural network joint optimization strategies. The optimization framework proposed in this paper introduces novel approaches to visual localization by integrating the advantages of 3D reconstruction and the heuristic refinement strategy, which demonstrates strong performance across multiple benchmark datasets, including 7Scenes and Deep Blending dataset. The implementation of our method has been released at https://github.com/anchang699/HGSLoc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。