通过梯度方向感知优化3D高斯点云密度,解决渲染过重建与冗余问题。
Gradient-Direction-Aware Density Control for 3D Gaussian Splatting
- 引入梯度一致性比,区分冲突与一致的梯度方向。
- 动态调整分裂与克隆策略,减少冗余并提升细节质量。
- 适合需要高效紧凑3D重建的应用场景。
3D高斯点云(3DGS)通过显式场景表示显著推动了新视角合成(NVS)的发展,实现实时逼真渲染。然而,在复杂场景中存在两大缺陷:(1) 持续存在的大高斯体无法满足自适应分割阈值,导致过重建,尤其在梯度方向冲突时难以有效分裂;(2) 梯度聚合方向一致区域出现过度密集化,引发冗余成分泛滥,显著增加内存开销。本文提出梯度方向感知高斯点云(GDAGS),核心创新包括:通过归一化梯度向量模长计算梯度一致性比(GCR),明确区分同向与异向梯度的高斯体;设计非线性动态加权机制,基于GCR实现梯度方向感知的密度控制。具体而言,分裂操作优先处理梯度冲突的高斯体以增强几何细节,抑制同向高斯体的冗余增长;克隆过程则促进同向高斯体的密化以完成结构,防止异向高斯体过量生成。在多个真实世界基准上的综合评估表明,GDAGS在保证优异渲染质量的同时,有效缓解过重建、抑制过密化,并构建紧凑的场景表示。
原文摘要 · Abstract (English)
The emergence of 3D Gaussian Splatting (3DGS) has significantly advanced Novel View Synthesis (NVS) through explicit scene representation, enabling real-time photorealistic rendering. However, existing approaches manifest two critical limitations in complex scenarios: (1) Over-reconstruction occurs when persistent large Gaussians cannot meet adaptive splitting thresholds during density control. This is exacerbated by conflicting gradient directions that prevent effective splitting of these Gaussians; (2) Over-densification of Gaussians occurs in regions with aligned gradient aggregation, leading to redundant component proliferation. This redundancy significantly increases memory overhead due to unnecessary data retention. We present Gradient-Direction-Aware Gaussian Splatting (GDAGS) to address these challenges. Our key innovations: the Gradient Coherence Ratio (GCR), computed through normalized gradient vector norms, which explicitly discriminates Gaussians with concordant versus conflicting gradient directions; and a nonlinear dynamic weighting mechanism leverages the GCR to enable gradient-direction-aware density control. Specifically, GDAGS prioritizes conflicting-gradient Gaussians during splitting operations to enhance geometric details while suppressing redundant concordant-direction Gaussians. Conversely, in cloning processes, GDAGS promotes concordant-direction Gaussian densification for structural completion while preventing conflicting-direction Gaussian overpopulation. Comprehensive evaluations across diverse real-world benchmarks demonstrate that GDAGS achieves superior rendering quality while effectively mitigating over-reconstruction, suppressing over-densification, and constructing compact scene representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。