arXiv:2412.04826cs.CV2024-12被引 4

通过挖掘多视角关键梯度,提升3D高斯点云渲染质量

Pushing Rendering Boundaries: Hard Gaussian Splatting

  • 用多视角显著梯度定位难优化的高斯点
  • 修复模糊与针状伪影,实现更清晰的实时渲染
  • 适合追求高质量3D重建的视觉研究者

3D高斯点云(3DGS)在实时渲染下实现了出色的新型视图合成(NVS)效果。训练中依赖视图空间位置梯度的平均值来增长高斯点以降低渲染误差,但平均操作会平滑来自不同视角的位置梯度和像素级渲染误差,阻碍许多缺陷高斯点的生长与优化,导致部分区域出现明显伪影。为此,我们提出硬高斯点云(HGS),通过考虑多视角显著位置梯度和明显渲染误差,挖掘并优化难以处理的高斯点,填补经典高斯点云在3D场景中的空缺,从而获得更优的NVS效果。具体而言,我们提出基于位置梯度驱动的HGS,利用多视角显著位置梯度发现难处理高斯点;同时提出基于渲染误差引导的HGS,识别显著像素误差及潜在过大的高斯点,联合挖掘硬样本。通过优化这些高斯点,本方法有效缓解了模糊与针状伪影。在多个数据集上的实验表明,该方法在保持实时效率的同时,达到当前最优的渲染质量。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has demonstrated impressive Novel View Synthesis (NVS) results in a real-time rendering manner. During training, it relies heavily on the average magnitude of view-space positional gradients to grow Gaussians to reduce rendering loss. However, this average operation smooths the positional gradients from different viewpoints and rendering errors from different pixels, hindering the growth and optimization of many defective Gaussians. This leads to strong spurious artifacts in some areas. To address this problem, we propose Hard Gaussian Splatting, dubbed HGS, which considers multi-view significant positional gradients and rendering errors to grow hard Gaussians that fill the gaps of classical Gaussian Splatting on 3D scenes, thus achieving superior NVS results. In detail, we present positional gradient driven HGS, which leverages multi-view significant positional gradients to uncover hard Gaussians. Moreover, we propose rendering error guided HGS, which identifies noticeable pixel rendering errors and potentially over-large Gaussians to jointly mine hard Gaussians. By growing and optimizing these hard Gaussians, our method helps to resolve blurring and needle-like artifacts. Experiments on various datasets demonstrate that our method achieves state-of-the-art rendering quality while maintaining real-time efficiency.

3D重建高斯点云渲染优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。