通过分层深度监督提升稀疏视角下的三维重建精度
Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss
- 采用多尺度深度一致性损失,逐步优化几何细节
- 在LLFF和DTU数据集上实现稀疏视图最优重建效果
- 适合关注三维重建质量的视觉算法研究者
新视角合成是3D计算机视觉中的基础任务,旨在从一组带位姿的图像中重建出逼真的新视角图像。然而,在稀疏视角条件下,由于几何线索不足,重建质量会急剧下降。现有方法如NeRF和3D Gaussian Splatting(3DGS)在稀疏观测下常出现细节模糊与结构伪影。近期研究指出,渲染深度质量是缓解此类问题的关键,因其直接影响几何精度与视角一致性。但稀疏视角下有效利用深度仍具挑战:深度先验可能噪声大或与渲染几何不匹配,单尺度监督难以同时捕捉全局结构与精细细节。为此,本文提出分层深度引导点阵(HDGS),一种逐级细化几何的深度监督框架。其核心为新型分层皮尔逊相关损失(CPCL),在多空间尺度上强制渲染深度与估计深度先验的一致性。通过多尺度深度一致性约束,显著提升了稀疏视角下的结构保真度。在LLFF和DTU数据集上的实验表明,该方法在稀疏视角设置下达到当前最优性能。
原文摘要 · Abstract (English)
Novel view synthesis is a fundamental task in 3D computer vision that aims to reconstruct photorealistic images from novel viewpoints given a set of posed images. However, reconstruction quality degrades sharply under sparse-view conditions due to insufficient geometric cues. Existing methods, including Neural Radiance Fields (NeRF) and more recent 3D Gaussian Splatting (3DGS), often exhibit blurred details and structural artifacts when trained from sparse observations. Recent works have identified rendered depth quality as a key factor in mitigating these artifacts, as it directly affects geometric accuracy and view consistency. However, effectively leveraging depth under sparse views remains challenging. Depth priors can be noisy or misaligned with rendered geometry, and single-scale supervision often fails to capture both global structure and fine details. To address these challenges, we introduce Hierarchical Depth-Guided Splatting (HDGS), a depth supervision framework that progressively refines geometry from coarse to fine levels. Central to HDGS is our novel Cascade Pearson Correlation Loss (CPCL), which enforces consistency between rendered and estimated depth priors across multiple spatial scales. By enforcing multi-scale depth consistency, our method improves structural fidelity in sparse-view reconstruction. Experiments on LLFF and DTU demonstrate state-of-the-art performance under sparse-view settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。