arXiv:2506.04115cs.CV2025-06IJCV被引 5

融合多视角法向与反照率信息,提升复杂材质的三维重建精度。

Multi-view Surface Reconstruction Using Normal and Reflectance Cues

  • 将法向和反照率联合建模为光照变化下的辐射量
  • 在多个基准数据集上达到当前最优重建效果
  • 适合需要精细细节重建的工业或影视场景

在缺乏密集视角且材料反射特性复杂的情况下,实现高保真三维表面重建仍具挑战。本文提出一种通用框架,将多视角法向图和可选的反照率图融入基于辐射率的表面重建中。方法通过像素级联合重参数化,将反射率与表面法向表示为模拟变化光照下的辐射量向量,可无缝集成至传统多视图立体(MVS)或现代神经体积渲染(NVR)流程中。结合后者,在多视角光度立体(MVPS)基准数据集DiLiGenT-MV、LUCES-MV和Skoltech3D上取得当前最优性能,尤其擅长还原细粒度结构并处理复杂可见性条件。本论文为2024年CVPR会议论文的扩展版,包含加速且更鲁棒的算法及更全面的实验评估。代码与数据见:https://github.com/RobinBruneau/RNb-NeuS2。

原文摘要 · Abstract (English)

Achieving high-fidelity 3D surface reconstruction while preserving fine details remains challenging, especially in the presence of materials with complex reflectance properties and without a dense-view setup. In this paper, we introduce a versatile framework that incorporates multi-view normal and optionally reflectance maps into radiance-based surface reconstruction. Our approach employs a pixel-wise joint re-parametrization of reflectance and surface normals, representing them as a vector of radiances under simulated, varying illumination. This formulation enables seamless incorporation into standard surface reconstruction pipelines, such as traditional multi-view stereo (MVS) frameworks or modern neural volume rendering (NVR) ones. Combined with the latter, our approach achieves state-of-the-art performance on multi-view photometric stereo (MVPS) benchmark datasets, including DiLiGenT-MV, LUCES-MV and Skoltech3D. In particular, our method excels in reconstructing fine-grained details and handling challenging visibility conditions. The present paper is an extended version of the earlier conference paper by Brument et al. (in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024), featuring an accelerated and more robust algorithm as well as a broader empirical evaluation. The code and data relative to this article is available at https://github.com/RobinBruneau/RNb-NeuS2.

三维重建表面重建反射建模神经渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。