2DGS-R通过分阶段训练提升渲染质量,同时保持几何精度。
2DGS-R: Revisiting the Normal Consistency Regularization in 2D Gaussian Splatting
- 先用法向一致性正则训练基础2D高斯,再对低质区域进行原位克隆增强。
- 仅增加1%存储和极少训练时间,渲染质量显著提升,几何细节更精确。
- 适合追求高保真渲染与精准几何重建的3D内容生成研究者。
3D高斯溅射(3DGS)虽能实现高保真渲染,但难以准确表示表面结构。2DGS将3D体数据转为2D平面高斯盘,虽提升了几何保真度,但渲染质量受限。这表明在单一训练阶段同时优化几何与渲染质量尚不可行。为此,我们提出2DGS-R,采用分层训练策略:首先以法向一致性正则训练原始2D高斯;随后识别渲染质量不佳的高斯并执行原位克隆操作进行增强;最后冻结透明度进行微调。实验表明,相比原始2DGS,2DGS-R仅需额外1%存储和极小训练时间,即可实现更高渲染质量与更精细的几何结构。结果验证了该方法在效率与性能间的良好平衡,显著提升视觉保真度与几何重建精度。
原文摘要 · Abstract (English)
Recent advancements in 3D Gaussian Splatting (3DGS) have greatly influenced neural fields, as it enables high-fidelity rendering with impressive visual quality. However, 3DGS has difficulty accurately representing surfaces. In contrast, 2DGS transforms the 3D volume into a collection of 2D planar Gaussian disks. Despite advancements in geometric fidelity, rendering quality remains compromised, highlighting the challenge of achieving both high-quality rendering and precise geometric structures. This indicates that optimizing both geometric and rendering quality in a single training stage is currently unfeasible. To overcome this limitation, we present 2DGS-R, a new method that uses a hierarchical training approach to improve rendering quality while maintaining geometric accuracy. 2DGS-R first trains the original 2D Gaussians with the normal consistency regularization. Then 2DGS-R selects the 2D Gaussians with inadequate rendering quality and applies a novel in-place cloning operation to enhance the 2D Gaussians. Finally, we fine-tune the 2DGS-R model with opacity frozen. Experimental results show that compared to the original 2DGS, our method requires only 1\% more storage and minimal additional training time. Despite this negligible overhead, it achieves high-quality rendering results while preserving fine geometric structures. These findings indicate that our approach effectively balances efficiency with performance, leading to improvements in both visual fidelity and geometric reconstruction accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。