构建合成数据集OB3D,专用于评测全景3D重建效果
OB3D: A New Dataset for Benchmarking Omnidirectional 3D Reconstruction Using Blender
- 用Blender生成复杂场景的多视角全景图像
- 提供全景相机参数和像素级深度/法向图真值
- 适合研究全景3D重建与畸变校正的学者
神经辐射场(NeRF)和3D高斯泼溅(3DGS)等基于辐射场的渲染技术推动了3D建模的发展。由于采集便捷且能全面覆盖场景,多视角360°全景图像日益成为主流。然而,常见全景表示(如等距柱状投影)在极区存在严重几何失真,且随纬度变化,极大影响高保真3D重建效果。现有数据集在特定挑战、场景构成和真值粒度上仍显不足,难以系统评估此类问题。为此,我们提出Omnidirectional Blender 3D(OB3D),一个面向多全景图像3D重建的合成数据集。该数据集基于Blender 3D项目生成多样化复杂场景,特别强调具有挑战性的布局。包含全景RGB图像、精确的全景相机参数、像素对齐的等距柱状投影深度图与法向图,并附带评估指标。通过提供受控但具有挑战性的环境,OB3D旨在促进现有方法的严谨评估,推动新算法发展以提升全景图像3D重建的精度与可靠性。
原文摘要 · Abstract (English)
Recent advancements in radiance field rendering, exemplified by Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have significantly progressed 3D modeling and reconstruction. The use of multiple 360-degree omnidirectional images for these tasks is increasingly favored due to advantages in data acquisition and comprehensive scene capture. However, the inherent geometric distortions in common omnidirectional representations, such as equirectangular projection (particularly severe in polar regions and varying with latitude), pose substantial challenges to achieving high-fidelity 3D reconstructions. Current datasets, while valuable, often lack the specific focus, scene composition, and ground truth granularity required to systematically benchmark and drive progress in overcoming these omnidirectional-specific challenges. To address this critical gap, we introduce Omnidirectional Blender 3D (OB3D), a new synthetic dataset curated for advancing 3D reconstruction from multiple omnidirectional images. OB3D features diverse and complex 3D scenes generated from Blender 3D projects, with a deliberate emphasis on challenging scenarios. The dataset provides comprehensive ground truth, including omnidirectional RGB images, precise omnidirectional camera parameters, and pixel-aligned equirectangular maps for depth and normals, alongside evaluation metrics. By offering a controlled yet challenging environment, OB3Daims to facilitate the rigorous evaluation of existing methods and prompt the development of new techniques to enhance the accuracy and reliability of 3D reconstruction from omnidirectional images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。