arXiv:2602.22565cs.CVcs.GR2026-02

用神经深度修正加速高保真3D重建,减少优化迭代。

SwiftNDC: Fast Neural Depth Correction for High-Fidelity 3D Reconstruction

  • 构建神经深度修正场,生成跨视角一致的深度图。
  • 仅需少量优化迭代即可实现高质量网格重建,提速显著。
  • 适合追求高效高精度3D重建的研究与工业应用。

基于深度引导的3D重建因其快速性成为优化密集型方法的替代方案,但现有方法仍存在尺度漂移、多视角不一致及需大量精修才能获得高保真几何的问题。本文提出SwiftNDC,一个围绕神经深度修正场构建的快速通用框架,可生成跨视角一致的深度图。利用这些优化后的深度图,通过反投影和鲁棒重投影误差过滤生成稠密点云,得到干净且均匀分布的几何初始化,为下游重建提供可靠基础。该高质量几何初始化显著加速3D高斯泼溅(3DGS)的网格重建过程,以极少优化迭代即实现优质表面。在新视角合成任务中,亦能提升3DGS渲染质量,凸显强几何初始化的优势。我们在五个数据集上开展全面评估,涵盖两个网格重建与三个新视角合成任务。结果表明,SwiftNDC在保证精度的前提下持续降低运行时间,并提升渲染保真度,验证了神经深度精修与鲁棒几何初始化结合在高效高保真3D重建中的有效性。

原文摘要 · Abstract (English)

Depth-guided 3D reconstruction has gained popularity as a fast alternative to optimization-heavy approaches, yet existing methods still suffer from scale drift, multi-view inconsistencies, and the need for substantial refinement to achieve high-fidelity geometry. Here, we propose SwiftNDC, a fast and general framework built around a Neural Depth Correction field that produces cross-view consistent depth maps. From these refined depths, we generate a dense point cloud through back-projection and robust reprojection-error filtering, obtaining a clean and uniformly distributed geometric initialization for downstream reconstruction. This reliable dense geometry substantially accelerates 3D Gaussian Splatting (3DGS) for mesh reconstruction, enabling high-quality surfaces with significantly fewer optimization iterations. For novel-view synthesis, SwiftNDC can also improve 3DGS rendering quality, highlighting the benefits of strong geometric initialization. We conduct a comprehensive study across five datasets, including two for mesh reconstruction, as well as three for novel-view synthesis. SwiftNDC consistently reduces running time for accurate mesh reconstruction and boosts rendering fidelity for view synthesis, demonstrating the effectiveness of combining neural depth refinement with robust geometric initialization for high-fidelity and efficient 3D reconstruction.

3D重建深度修正3DGS高效重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。