针对稀疏视角下的3D表面重建难题,提出新方法提升精度与渲染质量。
SparseSurf: Sparse-View 3D Gaussian Splatting for Surface Reconstruction
- 引入立体几何-纹理对齐机制,联合优化几何与渲染质量
- 通过伪特征增强多视角一致性,缓解稀疏监督下的过拟合
- 在DTU、BlendedMVS等数据集上达到当前最优性能
近期基于高斯点阵优化的场景几何重建方法实现了从图像中高效重构细节丰富的表面。然而,在输入视角稀疏时,此类优化易发生过拟合,导致重建质量下降。现有方法通过使用扁平化高斯原型以更好拟合表面几何,并结合深度正则化来缓解有限视点下的几何模糊问题。但扁平化高斯固有的各向异性加剧了稀疏视角下的过拟合,阻碍精确表面拟合并降低新视角合成效果。本文提出SparseSurf,通过引入立体几何-纹理对齐机制,连接渲染质量与几何估计,协同提升表面重建与视角合成表现。此外,提出伪特征增强的几何一致性约束,利用训练和未见视角共同强化多视图几何一致性,有效缓解稀疏监督引起的过拟合。在DTU、BlendedMVS和Mip-NeRF360数据集上的大量实验表明,本方法实现当前最优性能。
原文摘要 · Abstract (English)
Recent advances in optimizing Gaussian Splatting for scene geometry have enabled efficient reconstruction of detailed surfaces from images. However, when input views are sparse, such optimization is prone to overfitting, leading to suboptimal reconstruction quality. Existing approaches address this challenge by employing flattened Gaussian primitives to better fit surface geometry, combined with depth regularization to alleviate geometric ambiguities under limited viewpoints. Nevertheless, the increased anisotropy inherent in flattened Gaussians exacerbates overfitting in sparse-view scenarios, hindering accurate surface fitting and degrading novel view synthesis performance. In this paper, we propose \net{}, a method that reconstructs more accurate and detailed surfaces while preserving high-quality novel view rendering. Our key insight is to introduce Stereo Geometry-Texture Alignment, which bridges rendering quality and geometry estimation, thereby jointly enhancing both surface reconstruction and view synthesis. In addition, we present a Pseudo-Feature Enhanced Geometry Consistency that enforces multi-view geometric consistency by incorporating both training and unseen views, effectively mitigating overfitting caused by sparse supervision. Extensive experiments on the DTU, BlendedMVS, and Mip-NeRF360 datasets demonstrate that our method achieves the state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。