用渐进式伪视角增强稀疏视角3D高斯溅射重建效果
CuriGS: Curriculum-Guided Gaussian Splatting for Sparse View Synthesis
- 通过生成不同扰动级别的伪视角,逐步解锁训练难度
- 在合成与真实数据上均超越现有方法的画质与几何一致性
- 适合做稀疏视图3D重建的研究者与工业应用开发者
3D高斯溅射(3DGS)已成为实时场景重建与渲染的高效高保真表示方法。然而,将其扩展到稀疏视角设置仍面临监督信号稀缺和因视角覆盖有限导致的过拟合问题。本文提出CuriGS,一种基于课程引导的稀疏视角3D重建框架。CuriGS通过引入学生视角(伪视角)来解决核心挑战:围绕真实视角(教师)生成多组不同扰动程度的学生视角。训练过程中,按课程策略逐步开放更高扰动级别,从活跃级别随机采样候选学生辅助训练。每个采样学生通过深度相关性和协同正则化进行约束,并使用结合SSIM、LPIPS和图像质量度量的多信号指标评估。对于每个教师及扰动级别,定期保留表现最佳的学生,并将满足预设质量阈值的样本提升至训练集,实现稀疏训练视角的稳定增强。实验表明,CuriGS在多种合成与真实稀疏视角场景中,均优于当前最优基线,在渲染保真度和几何一致性方面表现更优。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has recently emerged as an efficient, high-fidelity representation for real-time scene reconstruction and rendering. However, extending 3DGS to sparse-view settings remains challenging because of supervision scarcity and overfitting caused by limited viewpoint coverage. In this paper, we present CuriGS, a curriculum-guided framework for sparse-view 3D reconstruction using 3DGS. CuriGS addresses the core challenge of sparse-view synthesis by introducing student views: pseudo-views sampled around ground-truth poses (teacher). For each teacher, we generate multiple groups of student views with different perturbation levels. During training, we follow a curriculum schedule that gradually unlocks higher perturbation level, randomly sampling candidate students from the active level to assist training. Each sampled student is regularized via depth-correlation and co-regularization, and evaluated using a multi-signal metric that combines SSIM, LPIPS, and an image-quality measure. For every teacher and perturbation level, we periodically retain the best-performing students and promote those that satisfy a predefined quality threshold to the training set, resulting in a stable augmentation of sparse training views. Experimental results show that CuriGS outperforms state-of-the-art baselines in both rendering fidelity and geometric consistency across various synthetic and real sparse-view scenes. Project page: https://zijian1026.github.io/CuriGS/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。