通过随机丢弃高斯点,缓解稀疏视角下的过拟合问题。
DropGaussian: Structural Regularization for Sparse-view Gaussian Splatting
- 训练时随机丢弃部分3D高斯点,类似dropout机制。
- 在三视角输入下,新视角图像质量显著提升,优于基线方法。
- 无需额外先验或复杂结构,适合快速部署的3D重建场景。
近期,3D高斯点阵(3DGS)因其快速生成高质量图像而受到广泛关注。然而,在稀疏视角设置(如三视角输入)中,3DGS常因对训练视图过拟合而导致新视角图像质量下降。现有方法多依赖强先验,如2D生成上下文信息或外部深度信号。本文提出无需先验的DropGaussian方法,仅在训练过程中随机移除部分高斯点,类似dropout操作。这一机制使未被剔除的高斯点获得更大梯度,提升其可见性,从而更有效地参与优化过程,缓解过拟合问题。仅通过在原始3DGS框架上应用该策略,即可在基准数据集的稀疏视角设置下达到与基于先验方法相当的性能,且无额外计算开销。代码与模型已公开于:https://github.com/DCVL-3D/DropGaussian release。
原文摘要 · Abstract (English)
Recently, 3D Gaussian splatting (3DGS) has gained considerable attentions in the field of novel view synthesis due to its fast performance while yielding the excellent image quality. However, 3DGS in sparse-view settings (e.g., three-view inputs) often faces with the problem of overfitting to training views, which significantly drops the visual quality of novel view images. Many existing approaches have tackled this issue by using strong priors, such as 2D generative contextual information and external depth signals. In contrast, this paper introduces a prior-free method, so-called DropGaussian, with simple changes in 3D Gaussian splatting. Specifically, we randomly remove Gaussians during the training process in a similar way of dropout, which allows non-excluded Gaussians to have larger gradients while improving their visibility. This makes the remaining Gaussians to contribute more to the optimization process for rendering with sparse input views. Such simple operation effectively alleviates the overfitting problem and enhances the quality of novel view synthesis. By simply applying DropGaussian to the original 3DGS framework, we can achieve the competitive performance with existing prior-based 3DGS methods in sparse-view settings of benchmark datasets without any additional complexity. The code and model are publicly available at: https://github.com/DCVL-3D/DropGaussian release.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。