用可微渲染计算光照参数对视觉指标的影响,揭示不同目标下的关键场景元素。
Scene Parameter Saliency via Differentiable Light Transport

- 通过反向传播计算渲染参数对图像指标的梯度,生成可解释的敏感度图。
- 不同视觉目标下参数重要性差异大,同一参数在不同任务中作用截然不同。
- 适合做渲染优化、视觉感知分析和人因设计的研究者使用。
基于梯度的显著性方法能揭示哪些输入特征最影响神经网络输出,是模型可解释性的标准工具。我们发现,可微渲染器(传统用于参数优化)能产生类似形式的显著性:针对渲染图像上任意标量指标,一次反向模式微分即可得到各参数梯度,从而识别出对指标影响最大的场景元素。我们将这些梯度场称为「指标显著性图」。与依赖学习权重传播的神经显著性不同,指标显著性通过图像形成过程本身(包括多光路传输)传播,捕捉到人工难以察觉的参数依赖关系。我们在多种不同目标上计算了显著性图:心理视觉眩光指数、平均场景亮度、神经感知评分。结果显示,相同场景在不同指标下的显著性排序差异显著,主导某一目标的参数对另一目标几乎无影响。显著性图取决于具体指标,而非场景固有属性。结果表明,可微渲染生成的导数图像在场景理解方面与原始图像同样具有信息量。
原文摘要 · Abstract (English)
Gradient-based saliency methods reveal which input features most influence a neural network's output, and are a standard tool for model interpretability. We observe that differentiable renderers, which are conventionally used for parameter optimisation, produce an analogous form of saliency: given any scalar metric evaluated on a rendered image, a single reverse-mode differentiation pass yields per-parameter gradients that identify which scene elements most influence the metric. We call these gradient fields metric saliency maps. Unlike neural saliency, which propagates attribution through learned weights, metric saliency propagates through the image formation process itself, including multi-bounce light transport, capturing parameter dependencies that are semi-opaque to manual inspection. We compute metric saliency maps for qualitatively different objectives: psychovisual glare indices, mean scene luminance, and neural perceptual scores. The saliency rankings differ substantially across metrics for the same scene, with parameters that dominate one objective being negligible for another. The saliency map is specific to the metric, not an intrinsic property of the scene. Our results suggest that differentiable renderers produce derivative images that are as informative for scene understanding as the primal images they were designed to generate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。