用单帧偏振显示实现高精度反向渲染,适合轻量桌面应用。
Snapshot Polarimetric Display Inverse Rendering

- 通过液晶屏投射偏振光,相机采集单帧光谱偏振数据
- 模型精准重建表面法向、反照率、粗糙度和金属度,误差低
- 自建偏振BRDF生成模型缓解训练数据不足问题
反向渲染在图形学与视觉领域仍是核心挑战,尤其在轻量化桌面工作流中,每帧信息预算极为受限。以往研究尝试利用时间调制、光谱编码和偏振等维度提升单次拍摄的信息量。本文提出偏振显示反向渲染方法:使用LCD投影线性偏振RGB二值图案,配合带四分之一波片的RGB偏振相机,单帧获取光谱-偏振测量数据。采用前馈Transformer网络将测量结果映射为每像素的法向、反照率、粗糙度和金属度。为应对训练数据稀缺,通过生成流形扩展有限实测偏振双向反射分布函数(BRDF)。在真实桌面系统上的评估表明,该方法在多种场景下均实现高精度反向渲染,优于现有方法。
原文摘要 · Abstract (English)
Inverse rendering remains a core challenge in graphics and vision, especially in the snapshot configurations required for lightweight desktop workflows, where the per-frame information budget is highly constrained. Previous inverse rendering work explores various available dimensions for enriching the per-shot information, including temporal modulation, spectral encoding, and polarization. In this work, we introduce polarimetric display inverse rendering, using an LCD to project a linearly polarized RGB binary pattern and an RGB polarization camera augmented with a quarter-wave plate to acquire spectro-polarimetric measurements in a single shot. A feed-forward transformer maps these measurements to per-pixel normal, albedo, roughness, and metallicity. To overcome training data scarcity, we expand a limited set of measured polarimetric bidirectional reflectance distribution functions via a generative manifold. Evaluations on a real desktop setup demonstrate accurate inverse rendering across diverse scenes, outperforming existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。