用费舍尔信息指导稀疏视角3D高斯点云,提升重建稳定性和画质。
From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information

- 基于费舍尔信息筛选关键视图,减少随机性增强稳定性
- 通过不确定性量化动态调整高斯点删除概率,避免过拟合
- 适合需要高保真重建的稀疏视角三维建模场景
3D高斯点云(3DGS)在新视角合成中表现优异,但依赖密集输入视图。在稀疏视图下,3DGS易过拟合,导致明显伪影和画质下降。现有方法引入深度先验或正则化(如Dropout),但缺乏理论指导,随机采样与随机删减加剧不确定性。本文提出一种基于费舍尔信息的新方法:(1) 利用费舍尔信息主动选择最具信息量的支持视图,并结合深度先验构建可靠伪真值,减少增强过程中的随机性;(2) 通过费舍尔信息量化每个3D高斯点的不确定性,自适应调整删除概率,实现更稳定的正则化。该方法有效缓解过拟合,提升优化稳定性,显著改善稀疏视图下的渲染保真度。大量实验表明,在多个稀疏视图新视角合成基准上达到当前最优性能。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has emerged as a promising technique for novel view synthesis. However, 3DGS requires dense input views to achieve high-quality rendering. In sparse-view scenarios, 3DGS often prones to overfitting, resulting in noticeable artifacts and degraded rendering quality. Previous methods explore to address this issue by introducing additional priors (e.g. depth priors) or integrating regularization techniques (e.g. Dropout). However, these methods are often applied without principled guidance. In particular, prior-based augmentation typically samples novel viewpoints randomly, while Dropout-based regularization randomly removes Gaussians. The compounded randomness introduces uncertainty and instability, limiting the fidelity of novel view synthesis. In this paper, we propose a novel method for sparse-view 3DGS that incorporates Fisher Information to quantitatively guide the utilization of geometric priors and regularization. Specifically, our method comprises two key components: (1) Stereo augmentation with Fisher Information. By leveraging Fisher Information, we actively select most informative supporting views and use depth priors to curate reliable pseudo ground truths, which reduces randomness in augmentation and improves stability and rendering fidelity; (2) Uncertainty-aware regularization. We reduce the instability of Dropout-based regularization by using Fisher Information to quantitatively measure the uncertainty of each 3D Gaussian, and adaptively adjust the removal probability, leading to more stable and effective regularization. With these two components, our method effectively mitigates overfitting and improves the stability of optimization in sparse-view 3DGS, resulting in superior rendering fidelity. Extensive experiments show that our method achieves state-of-the-art performance in sparse-view novel view synthesis benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。