让3D高斯点与相机位姿一起优化,提升重建质量
JOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting
- 先固定位姿优化高斯点,再用光流算法更新位姿,交替迭代
- 在视角变化大、特征稀疏时,投影误差明显降低
- 无需预标定,适合没有可靠位姿数据的场景
传统新视角合成方法依赖外部相机位姿估计工具(如COLMAP),常引入计算瓶颈并传播误差。为此,我们提出统一框架,联合优化3D高斯点与相机位姿,无需预标定输入。方法通过交替优化:第一阶段在固定位姿下利用可微渲染更新3D高斯参数;第二阶段采用融合几何与光度约束的定制3D光流算法精修相机位姿。该策略逐步减小投影误差,尤其在视角跨度大、特征分布稀疏的挑战性场景中表现优异。多数据集评估显示,本方法在重建质量上显著优于现有无COLMAP技术,且整体超越标准COLMAP基线。
原文摘要 · Abstract (English)
Traditional novel view synthesis methods heavily rely on external camera pose estimation tools such as COLMAP, which often introduce computational bottlenecks and propagate errors. To address these challenges, we propose a unified framework that jointly optimizes 3D Gaussian points and camera poses without requiring pre-calibrated inputs. Our approach iteratively refines 3D Gaussian parameters and updates camera poses through a novel co-optimization strategy, ensuring simultaneous improvements in scene reconstruction fidelity and pose estimation accuracy. The key innovation lies in decoupling the joint optimization into two interleaved phases: first, updating 3D Gaussian parameters via differentiable rendering with fixed poses, and second, refining camera poses using a customized 3D optical flow algorithm that incorporates geometric and photometric constraints. This formulation progressively reduces projection errors, particularly in challenging scenarios with large viewpoint variations and sparse feature distributions, where traditional methods struggle. Extensive evaluations on multiple datasets demonstrate that our approach significantly outperforms existing COLMAP-free techniques in reconstruction quality, and also surpasses the standard COLMAP-based baseline in general.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。