构建真实物体极化反射数据集,提升材质建模与逆渲染真实感
ICTPolarReal: A Polarized Reflection and Material Dataset of Real World Objects
- 用8相机346光源光场系统采集218个日常物体的极化反射数据
- 生成超120万张高分辨率图像,含漫反射/镜面分离与精确材质参数
- 支持材质分解、光照重演和稀疏视角三维重建,推动真实世界泛化
准确建模真实材料的光线反射仍是逆渲染的核心挑战,主要受限于实测反射数据稀缺。现有方法严重依赖简化光照和有限材质真实感的合成数据,导致模型难以泛化至真实图像。本文提出大规模真实物体极化反射与材质数据集ICTPolarReal,使用8相机346灯光场系统搭配交叉/平行偏振采集。数据覆盖218个日常物体,涵盖多视角、多光照、偏振、反射分离及材质属性五维采集维度,生成超过120万张高分辨率图像,包含漫反射-镜面分离结果,以及解析计算的漫反射反照率、镜面反照率与表面法线。基于该数据集,我们训练并评估了前沿逆向与正向渲染模型,在内在分解、光照重演和稀疏视角三维重建任务中显著提升了材质分离精度、光照保真度与几何一致性。本工作旨在为物理基础的材质理解建立新基准,实现超越合成训练范式的现实世界泛化能力。
原文摘要 · Abstract (English)
Accurately modeling how real-world materials reflect light remains a core challenge in inverse rendering, largely due to the scarcity of real measured reflectance data. Existing approaches rely heavily on synthetic datasets with simplified illumination and limited material realism, preventing models from generalizing to real-world images. We introduce a large-scale polarized reflection and material dataset of real-world objects, captured with an 8-camera, 346-light Light Stage equipped with cross/parallel polarization. Our dataset spans 218 everyday objects across five acquisition dimensions-multiview, multi-illumination, polarization, reflectance separation, and material attributes-yielding over 1.2M high-resolution images with diffuse-specular separation and analytically derived diffuse albedo, specular albedo, and surface normals. Using this dataset, we train and evaluate state-of-the-art inverse and forward rendering models on intrinsic decomposition, relighting, and sparse-view 3D reconstruction, demonstrating significant improvements in material separation, illumination fidelity, and geometric consistency. We hope that our work can establish a new foundation for physically grounded material understanding and enable real-world generalization beyond synthetic training regimes. Project page: https://jingyangcarl.github.io/ICTPolarReal/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。