解耦3D高斯溅射优化,提升效率与效果
A Step to Decouple Optimization in 3DGS
- 拆解优化过程为稀疏Adam、状态重校准和属性解耦正则化
- 新方法在多个框架下实现更优的重建质量与训练效率
- 适合关注3D内容生成与优化机制改进的研究者
3D高斯溅射(3DGS)已成为实时新视角合成的强大技术。作为通过原始单元间梯度传播优化的显式表示,其优化广泛采用深度神经网络中常见的同步权重更新及自适应梯度的Adam优化器。然而,考虑到3DGS的物理意义与特定设计,其优化中存在两个被忽视的关键问题:(i) 更新步长耦合导致优化器状态缩放与视点外昂贵的属性更新;(ii) 瞬时梯度耦合可能引发正则化不足或过强。这些复杂耦合尚未得到充分探索。本文重新审视3DGS优化过程,提出解耦策略,重构为:稀疏Adam、重状态正则化与解耦属性正则化。在3DGS与3DGS-MCMC框架下的大量实验表明,该方法深化了对各组件的理解。基于实证分析,我们重新组合有益成分,提出AdamW-GS,在保持更高优化效率的同时,显著提升表示有效性。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time novel view synthesis. As an explicit representation optimized through gradient propagation among primitives, optimization widely accepted in deep neural networks (DNNs) is actually adopted in 3DGS, such as synchronous weight updating and Adam with the adaptive gradient. However, considering the physical significance and specific design in 3DGS, there are two overlooked details in the optimization of 3DGS: (i) update step coupling, which induces optimizer state rescaling and costly attribute updates outside the viewpoints, and (ii) gradient coupling in the moment, which may lead to under- or over-effective regularization. Nevertheless, such a complex coupling is under-explored. After revisiting the optimization of 3DGS, we take a step to decouple it and recompose the process into: Sparse Adam, Re-State Regularization and Decoupled Attribute Regularization. Taking a large number of experiments under the 3DGS and 3DGS-MCMC frameworks, our work provides a deeper understanding of these components. Finally, based on the empirical analysis, we re-design the optimization and propose AdamW-GS by re-coupling the beneficial components, under which better optimization efficiency and representation effectiveness are achieved simultaneously.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。