提出CAdam方法,让3D高斯点云生成更高效,减少97%冗余点。
CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation

- 用梯度一阶矩区分几何信号与生成噪声,避免误增点。
- 在多个任务中将高斯点数量减少85%-97%,质量几乎不变。
- 适合追求生成效率的3D高斯点云优化研究者使用。
自适应密度化是3D高斯泼溅(3DGS)的核心机制,但在基于优化的生成蒸馏框架中,该重建导向的方法暴露出根本性局限,导致冗余点过多、表示效率低下。我们诊断此问题为‘密度化困境’,源于生成引导的随机性:标准基于幅值的累积会无差别融合瞬时噪声与几何信号,难以平衡过密化与欠拟合。为此,我们提出上下文自适应矩估计(CAdam),将密度化重新定义为统计意义上的信号验证问题。CAdam利用梯度一阶矩,借助干扰原理——随机波动通过相消干涉被抑制,而一致的几何漂移则通过相长干涉累积,从而有效分离出底层信号与生成噪声基底。该方法进一步结合分位数上下文感知与内在信噪比(SNR)门控机制,确保各优化阶段的鲁棒适应,并实现密度化的软终止。在多种目标(SDS, ISM, VFDS)和强生成式3DGS骨干网络上进行的大量实验表明,相较于标准密度化,CAdam可降低85%-97%的高斯点数量,同时保持相近的感知质量。结果凸显了信号感知密度控制在优化型生成蒸馏中的内存效率提升潜力。
原文摘要 · Abstract (English)
Adaptive densification is the engine of 3D Gaussian Splatting (3DGS). However, when transposed to the optimization-based Generative Distillation paradigm, this reconstruction-native mechanism reveals fundamental limitations, resulting in inefficient representations cluttered with redundant primitives. We diagnose this failure as a Densification Dilemma stemming from the stochastic nature of generative guidance: the standard magnitude-based accumulation indiscriminately aggregates transient noise alongside geometric signals, making it difficult to strike a balance between over-densification and under-fitting. To resolve this, we introduce Context-Adaptive Moment Estimation (CAdam), a novel framework that reinterprets densification as a statistically grounded signal verification problem. CAdam leverages the first moment of gradients to exploit the interference principle, where stochastic fluctuations cancel out via destructive interference while consistent geometric drifts accumulate via constructive interference, effectively disentangling the underlying signal from the generative noise floor. This is further augmented by a quantile-based context awareness and an intrinsic Signal-to-Noise Ratio (SNR) gating mechanism, which ensure robust adaptation across optimization stages and enable the soft termination of densification. Extensive experiments across diverse objectives (SDS, ISM, VFDS) and strong generative 3DGS backbones show that CAdam reduces Gaussian count by 85%-97% relative to standard densification while preserving overall comparable perceptual quality. These results highlight signal-aware density control as a practical way to improve memory efficiency in optimization-based generative distillation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。