用置信度自适应调节深度监督,提升3D高斯泼溅的几何精度
CDGS: Confidence-Aware Depth Regularization for 3D Gaussian Splatting
- 基于单目与SfM深度的置信图动态调整优化中的深度约束
- 在Tanks and Temples上提升2.31 dB PSNR,几何误差更低
- 仅需原训练量一半迭代即可达到相近精度,适合高效重建场景
3D高斯泼溅(3DGS)在新视角合成中表现出色,具备高速渲染和高质量输出的优势。然而,其在3D重建中的几何准确性受限于优化过程中缺乏显式几何约束。本文提出CDGS,一种置信度感知的深度正则化方法,利用单目深度估计的多线索置信图与稀疏结构光深度,自适应调节优化过程中的深度监督。该方法在早期训练阶段即实现更好的几何细节保留,并在新视角合成质量与几何准确性上达到竞争力表现。在公开的Tanks and Temples基准数据集上的实验表明,本方法具有更稳定的收敛行为和更精确的几何重建结果,新视角合成的PSNR最高提升2.31 dB,M3C2距离度量下的几何误差持续更低。值得注意的是,仅需原方法50%的训练迭代次数,即可达到相当的F-score。本工作有望推动数字孪生、文化遗产保护及林业等实际应用中高效且准确的3D重建系统发展。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has shown significant advantages in novel view synthesis (NVS), particularly in achieving high rendering speeds and high-quality results. However, its geometric accuracy in 3D reconstruction remains limited due to the lack of explicit geometric constraints during optimization. This paper introduces CDGS, a confidence-aware depth regularization approach developed to enhance 3DGS. We leverage multi-cue confidence maps of monocular depth estimation and sparse Structure-from-Motion depth to adaptively adjust depth supervision during the optimization process. Our method demonstrates improved geometric detail preservation in early training stages and achieves competitive performance in both NVS quality and geometric accuracy. Experiments on the publicly available Tanks and Temples benchmark dataset show that our method achieves more stable convergence behavior and more accurate geometric reconstruction results, with improvements of up to 2.31 dB in PSNR for NVS and consistently lower geometric errors in M3C2 distance metrics. Notably, our method reaches comparable F-scores to the original 3DGS with only 50% of the training iterations. We expect this work will facilitate the development of efficient and accurate 3D reconstruction systems for real-world applications such as digital twin creation, heritage preservation, or forestry applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。