用高斯可见性建模解决3D高斯点云重建中的几何一致性难题
GVGS: Gaussian Visibility-Aware Multi-View Geometry for Accurate Surface Reconstruction
- 在高斯粒度显式建模可见性,避免深度与可见性互依赖问题
- 在DTU和Tanks and Temples上重建精度显著优于现有高斯方法
- 适合做高精度3D重建的研究者与工业应用开发者
3D高斯溅射(3DGS)实现了高效渲染,但准确的表面重建仍面临几何监督不可靠的挑战。现有方法主要依赖基于深度的重投影来推断可见性并强制多视角一致性,导致根本性循环依赖:可见性估计需要精确深度,而深度监督本身又依赖于可见性。本文从可见性建模的角度重新审视多视角几何监督。我们不再通过像素级深度一致性推断可见性,而是显式在高斯原始层面建模可见性。提出高斯可见性感知的多视角几何一致性(GVMV)公式,通过聚合共享高斯的跨视角可见性,在共可见区域构建可靠监督。为进一步融入单目先验,提出渐进式四叉树校准深度对齐(QDC)策略,在可见性引导下进行块级仿射校准,有效缓解尺度模糊性的同时保留局部几何结构。在DTU和Tanks and Temples数据集上的大量实验表明,该方法在重建精度上持续优于先前基于高斯的方法。代码已开源,地址为匿名仓库:https://github.com/GVGScode/GVGS。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) enables efficient rendering, yet accurate surface reconstruction remains challenging due to unreliable geometric supervision. Existing approaches predominantly rely on depth-based reprojection to infer visibility and enforce multi-view consistency, leading to a fundamental circular dependency: visibility estimation requires accurate depth, while depth supervision itself is conditioned on visibility. In this work, we revisit multi-view geometric supervision from the perspective of visibility modeling. Instead of inferring visibility from pixel-wise depth consistency, we explicitly model visibility at the level of Gaussian primitives. We introduce a Gaussian visibility-aware multi-view geometric consistency (GVMV) formulation, which aggregates cross-view visibility of shared Gaussians to construct reliable supervision over co-visible regions. To further incorporate monocular priors, we propose a progressive quadtree-calibrated depth alignment (QDC) strategy that performs block-wise affine calibration under visibility-aware guidance, effectively mitigating scale ambiguity while preserving local geometric structures. Extensive experiments on DTU and Tanks and Temples demonstrate that our method consistently improves reconstruction accuracy over prior Gaussian-based approaches. Our code is fully open-sourced and available at an anonymous repository: https://github.com/GVGScode/GVGS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。