解决稀疏图像下3D高斯点云重建的模糊问题
Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequences

- 引入空间不确定性场,动态评估几何误差
- 按不确定性加权深度贡献,减少噪声保留细节
- 适合低密度图像场景,提升重建精度
3D高斯点阵(3DGS)在新视角合成中表现优异,但在稀疏图像序列中因数据不足导致优化时几何不确定性加剧,常陷入次优局部极小值,产生明显结构伪影。为此,提出不确定性感知的法向引导高斯点阵(UNG-GS),引入显式空间不确定性场(SUF)量化3DGS流程中的几何不确定性。通过高斯概率建模训练SUF,赋予模型自适应容错能力;采用不确定性加权深度渲染策略,根据SUF调整深度贡献,有效抑制噪声并保持细粒度特征;同时设计不确定性引导的法向优化方法,调节邻近深度值对法向估计的影响,增强鲁棒性。大量实验表明,UNG-GS在稀疏与密集序列上均显著优于当前最优方法。代码将开源。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has achieved impressive rendering performance in novel view synthesis. However, its efficacy diminishes considerably in sparse image sequences, where inherent data sparsity amplifies geometric uncertainty during optimization. This often leads to convergence at suboptimal local minima, resulting in noticeable structural artifacts in the reconstructed scenes.To mitigate these issues, we propose Uncertainty-aware Normal-Guided Gaussian Splatting (UNG-GS), a novel framework featuring an explicit Spatial Uncertainty Field (SUF) to quantify geometric uncertainty within the 3DGS pipeline. UNG-GS enables high-fidelity rendering and achieves high-precision reconstruction without relying on priors. Specifically, we first integrate Gaussian-based probabilistic modeling into the training of 3DGS to optimize the SUF, providing the model with adaptive error tolerance. An uncertainty-aware depth rendering strategy is then employed to weight depth contributions based on the SUF, effectively reducing noise while preserving fine details. Furthermore, an uncertainty-guided normal refinement method adjusts the influence of neighboring depth values in normal estimation, promoting robust results. Extensive experiments demonstrate that UNG-GS significantly outperforms state-of-the-art methods in both sparse and dense sequences. The code will be open-source.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。