arXiv:2604.26740cs.CVcs.GR2026-04

让采样点更懂渲染效果,用少量测量实现逼真材质还原。

Rendering-Aware Sparse Sampling for BRDF Acquisition

论文配图:Rendering-Aware Sparse Sampling for BRDF Acquisition
图 1 · 摘自论文原文
  • 基于渲染效果优化采样位置,而非仅重建BRDF空间。
  • 在极稀疏条件下(如16个样本)显著提升渲染质量。
  • 适合需要高精度材质采集的影视/游戏渲染场景。

准确获取材质的双向反射分布函数(BRDF)对真实感渲染至关重要,但密集的角反射仪测量耗时且成本高。本文研究如何选取少量最具信息量的BRDF测量点,以在学习到的BRDF先验下重建材料外观。现有稀疏采样方法通常针对所有材料优化BRDF空间重建,而感知重要性最终取决于其对具体渲染结果的影响。因此,本文将稀疏自适应采样建模为一个渲染感知的优化问题。方法结合了用于稀疏坐标-值观测的编码器、预训练的基于超网络或PCA的BRDF重构器,以及可微分渲染器。在采样器训练中,重构器保持固定,通过渲染图像损失的梯度优化测量位置。这分离了采样设计与先验拟合过程,促使采样器选择在学习到的材料分布下具有感知意义的方向。为确保公平比较,我们在相同样本数(如16)、训练/测试划分、渲染场景、物体掩码、图像映射和评估指标下,对比均匀采样基线、元学习方法、HyperBRDF方法及本方法。核心结论:当最终目标是渲染外观时,渲染感知采样能显著提升极稀疏情况下的材质获取性能。报告了仅使用BRDF空间损失与联合优化、仅图像隐变量拟合等消融实验,适用于未见材质。

原文摘要 · Abstract (English)

Accurate BRDF acquisition is essential for realistic rendering, but dense gonioreflectometer measurements are slow and expensive. We study how to select a small set of BRDF measurements that is most informative for reconstructing material appearance under a learned BRDF prior. Existing sparse-acquisition methods often optimize samples for BRDF-space reconstruction for all materials, while the perceptual importance of a adaptive measurement ultimately depends on its effect on each rendered appearance. We therefore formulate sparse adaptive acquisition as a rendering-aware optimization problem. Our method combines a set encoder for sparse coordinate--value observations, a pretrained hypernetwork-based/PCA-based BRDF reconstructor, and a differentiable renderer. During sampler training, the reconstructor remains fixed, and gradients from a rendered-image loss optimize the measurement locations. This separates acquisition design from prior fitting and encourages the sampler to choose directions that are informative under the learned material distribution. To make the comparison controlled, we evaluate the uniform baseline, meta-learning method, HyperBRDF method, and our learned sampler under matched sample numbers, train/test split, rendering scene, object mask, image mapping, and metrics. Our central claim: rendering-aware sampling improves extremely sparse BRDF acquisition when final rendered appearance is the target. BRDF-space and combined losses are reported only as ablations, together with joint refinement and image-only latent fitting for unseen materials.

材质捕获渲染感知稀疏采样可微分渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。