arXiv:2409.20140cs.CVcs.GR2024-09被引 3

基于SDF的可重光照系统,实现高反光物体的高质量材质重建与重光照。

RISE-SDF: a Relightable Information-Shared Signed Distance Field for Glossy Object Inverse Rendering

  • 两阶段学习:先建反射感知辐射场,再共享信息联合优化材质与几何。
  • 在自建数据集上,对高反射物体的重建精度优于现有方法。
  • 提出新分步渲染算法,提升间接光照质量,适合材质重建研究者。

本文提出一种端到端的可重光照神经逆向渲染系统,实现几何与材质属性的高质量重建,从而支持高质量重光照。核心是两阶段场景参数分解学习方法:第一阶段采用神经有符号距离场(SDF)表示几何,用MLP估计间接光照;第二阶段引入新型信息共享网络结构,联合学习辐射场与物理基分解。为降低蒙特卡洛采样噪声,采用简化迪士尼BRDF与立方体贴图金字塔作为环境光表示,实施分步近似。在重光照阶段,提出第二版分步算法,在分步渲染框架下追踪二次光线以增强间接光照质量。由于缺乏可用于高光物体逆向渲染的评估数据集与协议,我们构建了包含真实BRDF参数与重光照结果的新数据集。实验表明,该算法在逆向渲染与重光照任务中达到当前最优性能,尤其在高反射物体重建方面表现突出。

原文摘要 · Abstract (English)

In this paper, we propose a novel end-to-end relightable neural inverse rendering system that achieves high-quality reconstruction of geometry and material properties, thus enabling high-quality relighting. The cornerstone of our method is a two-stage approach for learning a better factorization of scene parameters. In the first stage, we develop a reflection-aware radiance field using a neural signed distance field (SDF) as the geometry representation and deploy an MLP (multilayer perceptron) to estimate indirect illumination. In the second stage, we introduce a novel information-sharing network structure to jointly learn the radiance field and the physically based factorization of the scene. For the physically based factorization, to reduce the noise caused by Monte Carlo sampling, we apply a split-sum approximation with a simplified Disney BRDF and cube mipmap as the environment light representation. In the relighting phase, to enhance the quality of indirect illumination, we propose a second split-sum algorithm to trace secondary rays under the split-sum rendering framework. Furthermore, there is no dataset or protocol available to quantitatively evaluate the inverse rendering performance for glossy objects. To assess the quality of material reconstruction and relighting, we have created a new dataset with ground truth BRDF parameters and relighting results. Our experiments demonstrate that our algorithm achieves state-of-the-art performance in inverse rendering and relighting, with particularly strong results in the reconstruction of highly reflective objects.

逆向渲染材质重建可重光照

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。