arXiv:2510.17479cs.CV2025-10被引 1

改进稀疏视角3D高斯点云初始化,显著提升新视角渲染质量。

Initialize to Generalize: A Stronger Initialization Pipeline for Sparse-View 3DGS

  • 通过低频视图增强与自监督点云补全,提升SfM在低纹理区域的覆盖
  • 在LLFF和Mip-NeRF360上实现稳定性能提升,新视角渲染更清晰无模糊
  • 适合关注稀疏视角三维重建的科研与工程人员

稀疏视角3D高斯喷溅(3DGS)常因过拟合训练视角导致新视角渲染出现模糊等伪影。现有方法或优化初始化(如结构光从运动,SfM),或增加训练时正则化约束。但控制性实验表明,初始化是决定性因素:它设定了性能上限,而训练约束仅能带来有限提升且成本更高。因此,本文聚焦于初始化设计。尽管SfM在稀疏视角下因特征匹配依赖而表现不佳,但仍能提供可靠初始点。为此,本文提出:(i) 频率感知SfM,通过低频视图增强与宽松多视图对应提升低纹理覆盖;(ii) 3DGS自初始化,将光度监督转化为额外点,用学习的高斯中心填补SfM稀疏区域;(iii) 点云正则化,通过简单几何/可见性先验强制多视图一致性与均匀空间分布,生成干净可靠的点云。在LLFF与Mip-NeRF360上的实验显示,该方法在稀疏视角设置下持续取得提升,验证其作为更强初始化策略的有效性。代码已开源。

原文摘要 · Abstract (English)

Sparse-view 3D Gaussian Splatting (3DGS) often overfits to the training views, leading to artifacts like blurring in novel view rendering. Prior work addresses it either by enhancing the initialization (\emph{i.e.}, the point cloud from Structure-from-Motion (SfM)) or by adding training-time constraints (regularization) to the 3DGS optimization. Yet our controlled ablations reveal that initialization is the decisive factor: it determines the attainable performance band in sparse-view 3DGS, while training-time constraints yield only modest within-band improvements at extra cost. Given initialization's primacy, we focus our design there. Although SfM performs poorly under sparse views due to its reliance on feature matching, it still provides reliable seed points. Thus, building on SfM, our effort aims to supplement the regions it fails to cover as comprehensively as possible. Specifically, we design: (i) frequency-aware SfM that improves low-texture coverage via low-frequency view augmentation and relaxed multi-view correspondences; (ii) 3DGS self-initialization that lifts photometric supervision into additional points, compensating SfM-sparse regions with learned Gaussian centers; and (iii) point-cloud regularization that enforces multi-view consistency and uniform spatial coverage through simple geometric/visibility priors, yielding a clean and reliable point cloud. Our experiments on LLFF and Mip-NeRF360 demonstrate consistent gains in sparse-view settings, establishing our approach as a stronger initialization strategy. Code is available at https://github.com/zss171999645/ItG-GS.

3D重建高斯喷溅初始化优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。