首个基于显示屏的逆渲染真实数据集，支持高精度材质重建。
A Real-world Display Inverse Rendering Dataset
- 用液晶屏+偏振相机构建系统，实现逐像素可控光照
- 涵盖多样物体，提供真实场景下几何与反射率真值
- 可模拟任意光照模式和噪声水平，适合算法评估与开发
逆渲染旨在从图像中恢复几何与反射属性。显示-相机成像系统具备独特优势：每个像素可作为可编程点光源，且液晶屏发出的偏振光有助于分离漫反射与镜面反射。尽管如此，目前尚无公开的真实世界显示-相机系统采集数据集，与光场阵列等其他系统相比存在明显差距。本文首次提出基于显示系统的逆渲染真实世界数据集。我们搭建并标定了一套由液晶屏和双目偏振相机组成的成像系统，并在逐光照明（OLAT）模式下采集多种具有复杂几何与反射特性的物体。同时提供高质量真实几何信息。该数据集支持在任意显示模式和不同噪声水平下合成图像。基于此，我们评估了现有光度立体与逆渲染方法性能，并提出了一个简单但高效的基准模型，表现优于当前最先进方法。代码与数据集已公开于 https://michaelcsj.github.io/DIR/
原文摘要 · Abstract (English)
Inverse rendering aims to reconstruct geometry and reflectance from captured images. Display-camera imaging systems offer unique advantages for this task: each pixel can easily function as a programmable point light source, and the polarized light emitted by LCD displays facilitates diffuse-specular separation. Despite these benefits, there is currently no public real-world dataset captured using display-camera systems, unlike other setups such as light stages. This absence hinders the development and evaluation of display-based inverse rendering methods. In this paper, we introduce the first real-world dataset for display-based inverse rendering. To achieve this, we construct and calibrate an imaging system comprising an LCD display and stereo polarization cameras. We then capture a diverse set of objects with diverse geometry and reflectance under one-light-at-a-time (OLAT) display patterns. We also provide high-quality ground-truth geometry. Our dataset enables the synthesis of captured images under arbitrary display patterns and different noise levels. Using this dataset, we evaluate the performance of existing photometric stereo and inverse rendering methods, and provide a simple, yet effective baseline for display inverse rendering, outperforming state-of-the-art inverse rendering methods. Code and dataset are available on our project page at https://michaelcsj.github.io/DIR/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。