用可学习的流模型提升逆渲染采样精度,降低方差。
TensoFlow: Tensorial Flow-based Sampler for Inverse Rendering
- 用归一化流构建可学习的采样器,同时支持方向与空间感知。
- 在合成与真实数据上,采样方差显著降低,重建质量更优。
- 适合需要高精度逆渲染的图形学与三维重建研究者。
逆渲染旨在从多视角图像中恢复场景几何、材质属性和光照。由于光-表面相互作用复杂,重要性采样对渲染方程求解至关重要,能降低方差并提高蒙特卡洛采样的效率。现有方法通常采用预定义的非学习性重要性采样器,难以有效匹配空间与方向变化的被积函数,导致方差高、性能不佳。为此,我们提出学习一种空间与方向感知的重要性采样器,以准确灵活地捕捉典型场景的复杂性。进一步提出TensoFlow,一种通用的逆渲染采样器学习框架,能够空间与方向上紧密匹配渲染方程的被积函数。具体而言,采样器由归一化流参数化,支持入射光方向采样与概率密度函数(PDF)推断;通过学习场景空间的张量表示,结合反射方向,实现空间与方向感知的采样分布。模型可通过最小化被积函数与归一化流之间的差异进行优化。大量实验验证了TensoFlow在合成与真实世界基准上的优越性。
原文摘要 · Abstract (English)
Inverse rendering aims to recover scene geometry, material properties, and lighting from multi-view images. Given the complexity of light-surface interactions, importance sampling is essential for the evaluation of the rendering equation, as it reduces variance and enhances the efficiency of Monte Carlo sampling. Existing inverse rendering methods typically use pre-defined non-learnable importance samplers in prior manually, struggling to effectively match the spatially and directionally varied integrand and resulting in high variance and suboptimal performance. To address this limitation, we propose the concept of learning a spatially and directionally aware importance sampler for the rendering equation to accurately and flexibly capture the unconstrained complexity of a typical scene. We further formulate TensoFlow, a generic approach for sampler learning in inverse rendering, enabling to closely match the integrand of the rendering equation spatially and directionally. Concretely, our sampler is parameterized by normalizing flows, allowing both directional sampling of incident light and probability density function (PDF) inference. To capture the characteristics of the sampler spatially, we learn a tensorial representation of the scene space, which imposes spatial conditions, together with reflected direction, leading to spatially and directionally aware sampling distributions. Our model can be optimized by minimizing the difference between the integrand and our normalizing flow. Extensive experiments validate the superiority of TensoFlow over prior alternatives on both synthetic and real-world benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。