arXiv:2410.10149cs.CVcs.GR2024-10

改进神经渲染的损失函数,训练更快更亮。

Fast and Accurate Neural Rendering Using Semi-Gradients

  • 用半梯度替代完整梯度,降低训练偏差与方差。
  • 在相同最优解下,训练速度提升3倍,画面更亮更清晰。
  • 适合实时渲染、可微渲染等需快速收敛的场景。

我们提出一种基于神经网络的全局光照渲染框架。近期基于最小化渲染方程左右两侧残差来学习神经辐射缓存的渲染技术被提出,因其实现简单且无需路径积分计算,已广泛应用于自由视角渲染、可微渲染和实时渲染等领域。然而,这些方法存在训练缓慢及渲染结果偶发变暗的问题。我们发现根源在于现有残差目标函数的梯度估计存在偏差与高方差。为此,我们引入新目标函数,在保持原有全局最优解的同时,支持无偏且低方差的梯度估计,从而实现神经网络的更快、更准确训练。该方法仅需忽略右侧项的部分导数即可实现,理论与实验分析均验证了其有效性。

原文摘要 · Abstract (English)

We propose a simple yet effective neural network-based framework for global illumination rendering. Recently, rendering techniques that learn neural radiance caches by minimizing the difference (i.e., residual) between the left and right sides of the rendering equation have been suggested. Due to their ease of implementation and the advantage of excluding path integral calculations, these techniques have been applied to various fields, such as free-viewpoint rendering, differentiable rendering, and real-time rendering. However, issues of slow training and occasionally darkened renders have been noted. We identify the cause of these issues as the bias and high variance present in the gradient estimates of the existing residual-based objective function. To address this, we introduce a new objective function that maintains the same global optimum as before but allows for unbiased and low-variance gradient estimates, enabling faster and more accurate training of neural networks. In conclusion, this method is simply implemented by ignoring the partial derivatives of the right-hand side, and theoretical and experimental analyses demonstrate the effectiveness of the proposed loss.

神经渲染图像生成优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。