构建900万张真实物体光照可控图像数据集,推动逆渲染与重光照技术落地
OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Control
- 765个真实物体多视角拍摄,331个独立光源精确控制光照
- 每物体配备35台相机+高精度法向量/反照率等辅助数据
- 首个面向逆渲染的全真实世界基准,适合算法验证与工业应用
我们提出OLATverse,一个包含约900万张图像的大规模真实物体数据集,涵盖765种常见与罕见实物,从多个视角在多样化且精确控制的光照条件下拍摄。现有逆渲染、新视角合成与重光照方法多依赖合成数据训练或小规模真实数据测试,限制了真实感与泛化能力。OLATverse通过大规模真实物体覆盖与高保真光照控制,弥补此缺口。每个物体由35台DSLR相机和331个独立调控光源采集,支持复杂光照模拟。同时提供校准相机参数、精确物体掩码、光度表面法向量及漫反射反照率等辅助资源。我们还构建了全面评估集,建立首个基于真实世界的物体中心逆渲染与法向量估计基准。该数据集将公开发布于https://vcai.mpi-inf.mpg.de/projects/OLATverse/,助力下一代逆渲染与重光照技术发展。
原文摘要 · Abstract (English)
We introduce OLATverse, a large-scale dataset comprising around 9M images of 765 real-world objects, captured from multiple viewpoints under a diverse set of precisely controlled lighting conditions. While recent advances in object-centric inverse rendering, novel view synthesis and relighting have shown promising results, most techniques still heavily rely on the synthetic datasets for training and small-scale real-world datasets for benchmarking, which limits their realism and generalization. To address this gap, OLATverse offers two key advantages over existing datasets: large-scale coverage of real objects and high-fidelity appearance under precisely controlled illuminations. Specifically, OLATverse contains 765 common and uncommon real-world objects, spanning a wide range of material categories. Each object is captured using 35 DSLR cameras and 331 individually controlled light sources, enabling the simulation of diverse illumination conditions. In addition, for each object, we provide well-calibrated camera parameters, accurate object masks, photometric surface normals, and diffuse albedo as auxiliary resources. We also construct an extensive evaluation set, establishing the first comprehensive real-world object-centric benchmark for inverse rendering and normal estimation. We believe that OLATverse represents a pivotal step toward integrating the next generation of inverse rendering and relighting methods with real-world data. The full dataset, along with all post-processing workflows, will be publicly released at https://vcai.mpi-inf.mpg.de/projects/OLATverse/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。