arXiv:2410.12414cs.GRcs.CV2024-10被引 2

用三角面片构建新框架,统一还原场景光照、材质与几何。

Triplet: Triangle Patchlet for Mesh-Based Inverse Rendering and Scene Parameters Approximation

  • 以三角面片为基本单元,结合渲染技术优化场景参数。
  • 无需先验信息,实现光照、材质、几何的高精度联合重建。
  • 适合需要物理真实感重建的三维视觉应用。

辐射场近年在新视角合成方面取得显著进展,但在实际应用中,逆向渲染——即推断场景的物理属性(如光照、几何、纹理和材质)——更具挑战性。尽管网格是许多仿真流程中的传统表示方式,却在辐射场逆向渲染中影响有限。本文提出一种基于网格的新框架——三角面片(Triangle Patchlet,简称Triplet),用于全面近似这些场景参数。我们通过随机点或相机标定获取的稀疏点组装三角面片,将每个面视为独立元素。随后,利用光的物理交互模拟,结合光栅化与光线追踪等传统图形渲染技术优化场景参数,并引入密度控制与传播机制。还提出迭代网格提取过程,通过图操作持续优化几何与材质。同时引入多种正则项以提升材质属性的泛化能力。该框架可在无光照、材质与几何先验条件下,统一估计三者。实验表明,本方法在视觉质量上达到当前最优水平,同时重建出高质量几何与精确材质属性。

原文摘要 · Abstract (English)

Recent advancements in Radiance Fields have significantly improved novel-view synthesis. However, in many real-world applications, the more advanced challenge lies in inverse rendering, which seeks to derive the physical properties of a scene, including light, geometry, textures, and materials. Meshes, as a traditional representation adopted by many simulation pipeline, however, still show limited influence in radiance field for inverse rendering. This paper introduces a novel framework called Triangle Patchlet (abbr. Triplet), a mesh-based representation, to comprehensively approximate these scene parameters. We begin by assembling Triplets with either randomly generated points or sparse points obtained from camera calibration where all faces are treated as an independent element. Next, we simulate the physical interaction of light and optimize the scene parameters using traditional graphics rendering techniques like rasterization and ray tracing, accompanying with density control and propagation. An iterative mesh extracting process is also suggested, where we continue to optimize on geometry and materials with graph-based operation. We also introduce several regulation terms to enable better generalization of materials property. Our framework could precisely estimate the light, materials and geometry with mesh without prior of light, materials and geometry in a unified framework. Experiments demonstrate that our approach can achieve state-of-the-art visual quality while reconstructing high-quality geometry and accurate material properties.

逆向渲染网格建模材质重建三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。