通过不确定性引导的可微透明度与软丢弃,提升稀疏视角3D高斯溅射质量。
UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGS
- 基于学习的不确定性动态调整高斯权重,实现可微更新。
- 在MipNeRF 360上比DropGaussian提升3.27% PSNR,用更少高斯点实现更好重建。
- 适合稀疏视角3D重建任务,尤其对过拟合敏感场景有显著优势。
3D高斯溅射(3DGS)因其高效的渲染性能,在新视角合成(NVS)中表现优异,但多数方法将高斯点视为同等权重,导致在稀疏视角下容易过拟合。本文研究自适应权重对渲染质量的影响,提出由学习到的不确定性表征驱动的方法。该不确定性一方面指导高斯透明度的可微更新,保持3DGS流程完整性;另一方面通过可微软丢弃正则化,将原始不确定性转化为连续丢弃概率,控制最终的高斯投影与混合过程。大量实验表明,本方法在多个标准数据集上优于现有稀疏视角方案,尤其在较少高斯点条件下实现更高重建质量。例如,在MipNeRF 360数据集上相较DropGaussian提升3.27% PSNR。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has become a competitive approach for novel view synthesis (NVS) due to its advanced rendering efficiency through 3D Gaussian projection and blending. However, Gaussians are treated equally weighted for rendering in most 3DGS methods, making them prone to overfitting, which is particularly the case in sparse-view scenarios. To address this, we investigate how adaptive weighting of Gaussians affects rendering quality, which is characterised by learned uncertainties proposed. This learned uncertainty serves two key purposes: first, it guides the differentiable update of Gaussian opacity while preserving the 3DGS pipeline integrity; second, the uncertainty undergoes soft differentiable dropout regularisation, which strategically transforms the original uncertainty into continuous drop probabilities that govern the final Gaussian projection and blending process for rendering. Extensive experimental results over widely adopted datasets demonstrate that our method outperforms rivals in sparse-view 3D synthesis, achieving higher quality reconstruction with fewer Gaussians in most datasets compared to existing sparse-view approaches, e.g., compared to DropGaussian, our method achieves 3.27\% PSNR improvements on the MipNeRF 360 dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。