arXiv:2502.10988cs.CV2025-02ICLR被引 2

让高斯点云的透明度更符合物理规律,提升材质建模精度

OMG: Opacity Matters in Material Modeling with Gaussian Splatting

  • 用神经网络建模材质与透明度的物理关系,引入真实光学原理
  • 在多个基线模型上实现视角生成和材质还原效果显著提升
  • 适合关注物理真实感渲染与逆向渲染的研究者

从一组图像中分解几何、材质和光照,即逆向渲染,是计算机视觉与图形学中的长期难题。近年来神经渲染的发展实现了逼真且可信的逆向渲染结果。3D高斯点云(Gaussian Splatting)的出现进一步推动了该领域,展现出实时渲染潜力。然而,现有方法未考虑透明度与材质属性(如截面)之间的物理依赖关系,这违背了光学原理。为此,我们提出一种新方法,在建模中显式引入此依赖:受辐射传输理论启发,通过神经网络以材质属性为输入,预测截面并采用物理正确的激活函数来增强透明度项。由此,材质参数的梯度不仅来自颜色,还来自透明度,从而形成更强优化约束。相比以往方法,本方法能更准确地建模物理属性。我们将该方法应用于三个基于高斯点云的逆向渲染基线,均在新视角合成与材质建模任务上取得显著改进。

原文摘要 · Abstract (English)

Decomposing geometry, materials and lighting from a set of images, namely inverse rendering, has been a long-standing problem in computer vision and graphics. Recent advances in neural rendering enable photo-realistic and plausible inverse rendering results. The emergence of 3D Gaussian Splatting has boosted it to the next level by showing real-time rendering potentials. An intuitive finding is that the models used for inverse rendering do not take into account the dependency of opacity w.r.t. material properties, namely cross section, as suggested by optics. Therefore, we develop a novel approach that adds this dependency to the modeling itself. Inspired by radiative transfer, we augment the opacity term by introducing a neural network that takes as input material properties to provide modeling of cross section and a physically correct activation function. The gradients for material properties are therefore not only from color but also from opacity, facilitating a constraint for their optimization. Therefore, the proposed method incorporates more accurate physical properties compared to previous works. We implement our method into 3 different baselines that use Gaussian Splatting for inverse rendering and achieve significant improvements universally in terms of novel view synthesis and material modeling.

逆向渲染高斯点云材质建模物理渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。