arXiv:2411.04984cs.CV2024-11SIGGRAPH被引 8

让神经辐射场准确还原玻璃等平面反光,避免误判为错误几何。

Planar Reflection-Aware Neural Radiance Fields

  • 通过显式追踪反射光线,联合建模镜面与反射源。
  • 在真实数据集上显著提升复杂反光的重建精度。
  • 适合需要高保真反光渲染的应用,如虚拟现实。

神经辐射场(NeRF)在高保真场景重建方面表现卓越,但其视角依赖性难以处理高频反射,尤其在面对窗户等平面反光时,常将反射误判为错误几何,导致重复和失真的场景表示。为此,我们提出一种反射感知的NeRF,联合建模平面反射体(如窗户),并显式投射反射光线以捕获高频反射的来源。通过查询单一辐射场,同时渲染主颜色与反射源。我们设计了一种稀疏边缘正则化,帮助利用真实的反射源进行渲染,而非在主射线上同深度处生成冗余副本。结果实现了精确的场景几何重建:沿主射线渲染可得无反射的清晰视图,而显式沿反射射线渲染则能重构高度细节化的反射。在多个真实世界数据集上的定量与定性评估表明,该方法在准确处理反射方面性能显著提升。

原文摘要 · Abstract (English)

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex planar reflections, often interpreting them as erroneous scene geometries and leading to duplicated and inaccurate scene representations. To address this challenge, we introduce a reflection-aware NeRF that jointly models planar reflectors, such as windows, and explicitly casts reflected rays to capture the source of the high-frequency reflections. We query a single radiance field to render the primary color and the source of the reflection. We propose a sparse edge regularization to help utilize the true sources of reflections for rendering planar reflections rather than creating a duplicate along the primary ray at the same depth. As a result, we obtain accurate scene geometry. Rendering along the primary ray results in a clean, reflection-free view, while explicitly rendering along the reflected ray allows us to reconstruct highly detailed reflections. Our extensive quantitative and qualitative evaluations of real-world datasets demonstrate our method's enhanced performance in accurately handling reflections.

NeRF反光重建辐射场视觉几何

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。