arXiv:2409.06923cs.CV2024-09ECCV被引 3

提出一种新方向参数化,提升复杂表面3D重建效果。

Rethinking Directional Parameterization in Neural Implicit Surface Reconstruction

  • 设计混合方向参数化,融合视角与反射方向优势
  • 在多种材质和几何结构上均表现更优,避免过平或失真
  • 几乎无额外参数,可无缝集成到现有方法中

基于神经隐式表示的多视角3D表面重建在统一建模几何与视向辐射场方面取得显著进展。然而,其对镜面或复杂表面的重建效果常受限于视向辐射网络中的方向参数化方式。常用的方向参数化包括视角方向和反射方向,但各有局限:仅使用视角方向难以正确分离高度镜面物体的几何与外观,而采用反射方向则导致凹面或复杂结构重建结果过于平滑。本文深入分析两类方法的失败案例,提出一种新型混合方向参数化,在统一框架下克服各自缺陷。大量实验表明,所提方法在多种材质、几何和外观的物体重建中均表现稳定且优越,而其他参数化方式在特定物体上仍面临挑战。此外,该混合参数化几乎无需额外参数,可轻松应用于任何现有神经表面重建方法。

原文摘要 · Abstract (English)

Multi-view 3D surface reconstruction using neural implicit representations has made notable progress by modeling the geometry and view-dependent radiance fields within a unified framework. However, their effectiveness in reconstructing objects with specular or complex surfaces is typically biased by the directional parameterization used in their view-dependent radiance network. {\it Viewing direction} and {\it reflection direction} are the two most commonly used directional parameterizations but have their own limitations. Typically, utilizing the viewing direction usually struggles to correctly decouple the geometry and appearance of objects with highly specular surfaces, while using the reflection direction tends to yield overly smooth reconstructions for concave or complex structures. In this paper, we analyze their failed cases in detail and propose a novel hybrid directional parameterization to address their limitations in a unified form. Extensive experiments demonstrate the proposed hybrid directional parameterization consistently delivered satisfactory results in reconstructing objects with a wide variety of materials, geometry and appearance, whereas using other directional parameterizations faces challenges in reconstructing certain objects. Moreover, the proposed hybrid directional parameterization is nearly parameter-free and can be effortlessly applied in any existing neural surface reconstruction method.

3D重建神经隐式方向参数化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。