通过联合优化姿态与外观,提升3D高斯点云重建速度和精度。
GloSplat: Joint Pose-Appearance Optimization for Faster and More Accurate 3D Reconstruction
- 保留显式特征轨迹作为可优化参数,结合几何与光度监督。
- 在无COLMAP情况下达到顶尖性能,有COLMAP时超越所有基线。
- 适合需要快速高精度3D重建的场景,如实时应用或大规模建模。
特征提取、匹配、结构光运动(SfM)和新视角合成(NVS)传统上被视为独立问题,各自有独立优化目标。我们提出GloSplat,一种在3D高斯点云(3DGS)训练中进行姿态-外观联合优化的框架。不同于以往依赖纯光度梯度的姿态优化方法(如BARF、NeRF--、3RGS),GloSplat将显式SfM特征轨迹作为第一类实体保留在训练全程:轨迹3D点作为独立可优化参数,与高斯原始项分离,通过重投影损失提供持续的几何锚点,与光度监督并行。这一设计防止了早期姿态漂移,支持精细调整——这是仅靠光度方法无法实现的。我们提出两种变体:(1) GloSplat-F,基于检索的配对选择,无需COLMAP,效率高;(2) GloSplat-A,全量匹配,追求最高质量。两者均采用全局SfM初始化,并在3DGS训练中执行联合光度-几何优化。实验表明,GloSplat-F在无COLMAP方法中表现最佳,而GloSplat-A超越所有基于COLMAP的基线。
原文摘要 · Abstract (English)
Feature extraction, matching, structure from motion (SfM), and novel view synthesis (NVS) have traditionally been treated as separate problems with independent optimization objectives. We present GloSplat, a framework that performs \emph{joint pose-appearance optimization} during 3D Gaussian Splatting training. Unlike prior joint optimization methods (BARF, NeRF--, 3RGS) that rely purely on photometric gradients for pose refinement, GloSplat preserves \emph{explicit SfM feature tracks} as first-class entities throughout training: track 3D points are maintained as separate optimizable parameters from Gaussian primitives, providing persistent geometric anchors via a reprojection loss that operates alongside photometric supervision. This architectural choice prevents early-stage pose drift while enabling fine-grained refinement -- a capability absent in photometric-only approaches. We introduce two pipeline variants: (1) \textbf{GloSplat-F}, a COLMAP-free variant using retrieval-based pair selection for efficient reconstruction, and (2) \textbf{GloSplat-A}, an exhaustive matching variant for maximum quality. Both employ global SfM initialization followed by joint photometric-geometric optimization during 3DGS training. Experiments demonstrate that GloSplat-F achieves state-of-the-art among COLMAP-free methods while GloSplat-A surpasses all COLMAP-based baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。