arXiv:2607.00885cs.CVcs.AI2026-07中稿 · ECCV被引 1

通过平坦极小值优化,提升稀疏视角下3DGS的泛化能力

Improving Sparse-View 3DGS Generalization via Flat Minima Optimization

论文配图:Improving Sparse-View 3DGS Generalization via Flat Minima Optimization
图 1 · 摘自论文原文
  • 引入平坦极小值思想,对高斯参数施加可控扰动以增强鲁棒性
  • 在LLFF和Mip-NeRF360上实现更清晰、更稳定的新视角重建
  • 无需修改架构,适合希望提升3DGS泛化的研究者与开发者

神经渲染近年发展使3D高斯泼溅(3DGS)成为高效的新视角合成表示,具备快速训练与实时渲染能力。然而当输入视角稀疏时,3DGS易过拟合观测图像,泛化能力差。本文从平坦极小值(FM)优化角度出发,将高斯参数视为可训练权重,设计轻量级训练框架,引入考虑各高斯各向异性和训练进度的可控扰动,保留细节同时提升对稀疏视角过拟合的鲁棒性。为进一步稳定优化过程,提出周期性重初始化策略,短暂将非位置参数恢复至初始状态。该方法无缝集成于现有3DGS流程,无需结构改动。在LLFF与Mip-NeRF360数据集上的实验表明,该方法显著提升定量指标与感知质量,重建结果更锐利、更稳定、泛化性更强。

原文摘要 · Abstract (English)

Recent advances in neural rendering have established 3D Gaussian Splatting (3DGS) as a highly efficient representation for novel view synthesis, enabling fast training and real-time rendering with strong fidelity. However, when supervision is limited to sparse input views, 3DGS tends to overfit to the observed images and generalize poorly to unseen viewpoints. We address this challenge from the perspective of flat minima (FM) optimization, which seeks solutions that remain stable under small parameter perturbations. Viewing Gaussian parameters as trainable weights, we adapt FM principles to the geometric and dynamic nature of 3DGS with a lightweight training framework. Our method regularizes optimization with controlled Gaussian perturbations that account for each Gaussian's anisotropy and the training progress, preserving fine details while improving robustness to sparse-view overfitting. To further stabilize this flat minima optimization process, we introduce periodic reinitialization, which temporarily returns non-positional parameters to their initial states for a short window. Together, these techniques integrate seamlessly into existing 3DGS pipelines without architectural changes. Experiments on LLFF and Mip-NeRF360 datasets demonstrate improved quantitative metrics and perceptual quality under sparse-view supervision, producing reconstructions that are sharper, more stable, and better generalized to novel viewpoints.

3DGS泛化能力平坦极小值稀疏视图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。