构建首个大规模真实户外反照率与阴影数据集,助力真实场景光照重建。
Olbedo: An Albedo and Shading Aerial Dataset for Large-Scale Outdoor Environments
- 基于多视角立体重建与逆渲染流程,生成高精度反照率与阴影图
- 包含5664张无人机图像,覆盖四类地貌与多时相光照条件
- 支持城市数字孪生、材质编辑等应用,适合光照感知视觉研究者
户外场景的固有图像分解对重光照、编辑和理解大尺度环境至关重要,但受限于缺乏真实世界中可靠的反照率与阴影标注数据。我们提出Olbedo,一个面向野外大尺度户外环境的反照率-阴影分解大规模航拍数据集。该数据集包含5,664张无人机图像,覆盖四种景观类型、多个年份及多样光照条件。每张图像配有保持多视图一致性的反照率与阴影图、度量深度、表面法向、太阳与天空阴影分量、相机位姿,以及近期飞行获取的实测HDR天穹数据。这些标注通过多视角立体重建与校准天空光照基础上的逆渲染优化流程生成,并附带逐像素置信度掩码。实验表明,使用Olbedo微调原本在合成室内数据上训练的扩散模型,可显著提升其在真实户外图像上的单视图反照率预测性能,在MatrixCity基准上实现当前最优表现。进一步展示了基于Olbedo训练模型在3D资产多视图一致性重光照、材质编辑及城市数字孪生场景变化分析中的应用。我们公开数据集、基线模型与评估协议,以推动户外固有分解与光照感知航拍视觉研究。
原文摘要 · Abstract (English)
Intrinsic image decomposition (IID) of outdoor scenes is crucial for relighting, editing, and understanding large-scale environments, but progress has been limited by the lack of real-world datasets with reliable albedo and shading supervision. We introduce Olbedo, a large-scale aerial dataset for outdoor albedo--shading decomposition in the wild. Olbedo contains 5,664 UAV images captured across four landscape types, multiple years, and diverse illumination conditions. Each view is accompanied by multi-view consistent albedo and shading maps, metric depth, surface normals, sun and sky shading components, camera poses, and, for recent flights, measured HDR sky domes. These annotations are derived from an inverse-rendering refinement pipeline over multi-view stereo reconstructions and calibrated sky illumination, together with per-pixel confidence masks. We demonstrate that Olbedo enables state-of-the-art diffusion-based IID models, originally trained on synthetic indoor data, to generalize to real outdoor imagery: fine-tuning on Olbedo significantly improves single-view outdoor albedo prediction on the MatrixCity benchmark. We further illustrate applications of Olbedo-trained models to multi-view consistent relighting of 3D assets, material editing, and scene change analysis for urban digital twins. We release the dataset, baseline models, and an evaluation protocol to support future research in outdoor intrinsic decomposition and illumination-aware aerial vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。