arXiv:2503.18361cs.CV2025-03CVPR被引 18

用NeRF做先验,同时学形状和颜色,快速重建室内场景。

NeRFPrior: Learning Neural Radiance Field as a Prior for Indoor Scene Reconstruction

  • 用NeRF作为先验,联合学习几何与颜色信息
  • 在标准数据集上优于现有方法,尤其在纹理缺失区域表现更好
  • 无需额外数据,训练快,适合室内3D重建任务

近期研究表明,先验对神经隐式函数从多视角RGB图像中重建高质量表面至关重要。然而,现有先验需大规模预训练,且仅提供几何线索,忽视颜色信息。本文提出NeRFPrior,采用神经辐射场作为先验,通过体渲染学习符号距离场以实现表面重建。该先验可同时提供几何与颜色线索,并在相同场景下无需额外数据即可快速训练。基于此先验,我们通过显式施加每条射线交点的多视角一致性约束来学习符号距离函数(SDF)。具体而言,在每个射线交点处,利用先验中的密度进行粗略几何估计,同时利用表面附近颜色作为另一视角可见性判断依据。针对多视角一致性失效的纹理缺失区域,进一步引入带置信度权重的深度一致性损失以推断SDF。实验结果表明,该方法在广泛使用的基准上优于当前最优方法。

原文摘要 · Abstract (English)

Recently, it has shown that priors are vital for neural implicit functions to reconstruct high-quality surfaces from multi-view RGB images. However, current priors require large-scale pre-training, and merely provide geometric clues without considering the importance of color. In this paper, we present NeRFPrior, which adopts a neural radiance field as a prior to learn signed distance fields using volume rendering for surface reconstruction. Our NeRF prior can provide both geometric and color clues, and also get trained fast under the same scene without additional data. Based on the NeRF prior, we are enabled to learn a signed distance function (SDF) by explicitly imposing a multi-view consistency constraint on each ray intersection for surface inference. Specifically, at each ray intersection, we use the density in the prior as a coarse geometry estimation, while using the color near the surface as a clue to check its visibility from another view angle. For the textureless areas where the multi-view consistency constraint does not work well, we further introduce a depth consistency loss with confidence weights to infer the SDF. Our experimental results outperform the state-of-the-art methods under the widely used benchmarks.

3D重建NeRF符号距离场多视角一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。