用相机势场解决稀疏视角3D高斯点云过拟合问题
GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting

- 构建相机势场量化视角间监督不均衡
- 在低势能区增设虚拟相机提升几何引导
- 适配稀疏视角重建,提升精度与稳定性
3D高斯点云渲染在高质量图像生成方面取得显著进展,但在稀疏视角场景中因光度监督不足而出现严重过拟合和几何失真。现有方法尝试引入深度、点云或扩散模型等外部先验进行优化,但通常忽略视图空间内监督分布的非均匀性,导致先验使用缺乏针对性和控制力。本文提出GSPotential框架,通过相机势场量化视图空间的监督不平衡。核心思想是识别光度约束最薄弱的监督洼地,并利用势场从两个互补角度指导重建:首先设计概率球面采样策略,在低势能区域放置信息丰富的虚拟相机,其点云渲染提供精准几何引导;其次,同一势场为弱覆盖空间区域提供方向性覆盖提示,实现保守的高斯更新。大量实验表明,GSPotential在保持竞争性训练效率的同时,实现了高保真重建。
原文摘要 · Abstract (English)
3D Gaussian Splatting has achieved remarkable success in photorealistic rendering, yet it suffers from severe overfitting and geometric artifacts in sparse-view scenarios due to the inherent deficiency of photometric supervision. Recent advances have attempted to regularize optimization by incorporating external priors, such as depth, point clouds, or diffusion models. However, these methods typically overlook the non-uniform distribution of supervision across the viewing space, resulting in limited specificity in prior use and primitive control. In this paper, we propose GSPotential, a framework that quantifies view-space supervision imbalance using a Camera Potential Field. Our key insight is to identify supervision valleys where photometric constraints are most deficient, and use the potential field to guide reconstruction from two complementary aspects. First, we devise a probabilistic spherical sampling strategy that places informative virtual cameras in low-potential regions. Point-cloud renderings from these views then provide targeted geometric guidance. Second, the same field provides a directional coverage cue for conservative Gaussian updates in weakly covered spatial sectors. Extensive experiments demonstrate that GSPotential achieves high reconstruction fidelity while maintaining competitive training efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。