arXiv:2411.19454cs.CV2024-11被引 34

用几何引导提升3D高斯点云的表面重建质量。

GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction

  • 分纹理与无纹理区域分别用MVS和法向先验引导优化
  • 在DTU和Tanks and Temples上精度更高、训练更快
  • 适合需要精细表面建模的三维重建任务

3D高斯点云在新视角合成中表现出色,具备实时渲染能力。然而,用3D高斯实现高质量、细节丰富的表面重建仍具挑战。本文提出GausSurf,通过多视图一致性(纹理丰富区)和法向先验(无纹理区)进行几何引导,实现高质量表面重建。我们发现场景可分为两类:纹理丰富区与无纹理区。针对纹理丰富区,引入基于patch-match的多视图立体(MVS)方法,在迭代优化中与高斯点云优化相互增强,显著提升重建效果并加速训练。对于无纹理区,利用预训练法向估计模型提供的法向先验引导优化。在DTU和Tanks and Temples数据集上的大量实验表明,本方法在重建质量与计算效率上均优于现有最佳方法。

原文摘要 · Abstract (English)

3D Gaussian Splatting has achieved impressive performance in novel view synthesis with real-time rendering capabilities. However, reconstructing high-quality surfaces with fine details using 3D Gaussians remains a challenging task. In this work, we introduce GausSurf, a novel approach to high-quality surface reconstruction by employing geometry guidance from multi-view consistency in texture-rich areas and normal priors in texture-less areas of a scene. We observe that a scene can be mainly divided into two primary regions: 1) texture-rich and 2) texture-less areas. To enforce multi-view consistency at texture-rich areas, we enhance the reconstruction quality by incorporating a traditional patch-match based Multi-View Stereo (MVS) approach to guide the geometry optimization in an iterative scheme. This scheme allows for mutual reinforcement between the optimization of Gaussians and patch-match refinement, which significantly improves the reconstruction results and accelerates the training process. Meanwhile, for the texture-less areas, we leverage normal priors from a pre-trained normal estimation model to guide optimization. Extensive experiments on the DTU and Tanks and Temples datasets demonstrate that our method surpasses state-of-the-art methods in terms of reconstruction quality and computation time.

3D重建高斯点云几何引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。