arXiv:2508.12720cs.CV2025-08NeurIPS被引 14

发现稀疏视角3D高斯泼溅的视觉伪影源于高斯点过度耦合,提出轻量级解决方案。

Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splatting

  • 用像素方差法量化高斯点间耦合程度,揭示问题根源。
  • 在少量训练视图下,耦合度显著升高导致新视角出现伪影。
  • 添加随机丢弃或透明度噪声,即可有效缓解伪影,兼容性强。

3D高斯泼溅(3DGS)在密集视角设置下表现优异,但在稀疏视角场景中,尽管训练视角渲染逼真,新视角常出现外观伪影。本文分析发现,其核心问题是优化后的高斯点过度耦合,为拟合训练视角而忽视真实场景外观分布。为此提出新的评估指标——共适应度(CA),通过不同随机高斯子集对同一视角多次渲染计算像素级方差来量化耦合程度。分析表明,随着训练视角数量增加,共适应度自然降低。基于此,提出两种轻量级策略:(1)随机高斯点丢弃;(2)对透明度注入乘性噪声。二者均为即插即用设计,在多种方法与基准上验证有效。本工作旨在推动社区对稀疏视角3DGS中耦合效应的深入理解。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in novel view synthesis under dense-view settings. However, in sparse-view scenarios, despite the realistic renderings in training views, 3DGS occasionally manifests appearance artifacts in novel views. This paper investigates the appearance artifacts in sparse-view 3DGS and uncovers a core limitation of current approaches: the optimized Gaussians are overly-entangled with one another to aggressively fit the training views, which leads to a neglect of the real appearance distribution of the underlying scene and results in appearance artifacts in novel views. The analysis is based on a proposed metric, termed Co-Adaptation Score (CA), which quantifies the entanglement among Gaussians, i.e., co-adaptation, by computing the pixel-wise variance across multiple renderings of the same viewpoint, with different random subsets of Gaussians. The analysis reveals that the degree of co-adaptation is naturally alleviated as the number of training views increases. Based on the analysis, we propose two lightweight strategies to explicitly mitigate the co-adaptation in sparse-view 3DGS: (1) random gaussian dropout; (2) multiplicative noise injection to the opacity. Both strategies are designed to be plug-and-play, and their effectiveness is validated across various methods and benchmarks. We hope that our insights into the co-adaptation effect will inspire the community to achieve a more comprehensive understanding of sparse-view 3DGS.

3D生成高斯泼溅视角泛化去耦合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。