首个近场点光源多视角摄影立体数据集,助力真实场景三维重建
LUCES-MV: A Multi-View Dataset for Near-Field Point Light Source Photometric Stereo
- 构建15个物体的多视角近场点光源图像,光距相机30-40厘米
- 包含真值法向、网格、姿态及标定图像,支持端到端评估
- 适合研究真实光照下高精度三维重建的算法开发者
摄影立体领域近年进步主要来自可微体渲染技术(如NeRF或Neural SDF),在DiLiGenT-MV基准上实现0.2mm重建误差。然而,现有环境光照数据集(如DTS)丰富,而摄影立体专用数据集仍稀少,且常缺少简单、光滑、无纹理等挑战性物体,以及实际的小型近场光源设置。为此,我们提出LUCES-MV,首个面向近场点光源摄影立体的真实世界多视角数据集。数据集包含15个材质各异的物体,每个物体在15个LED组成的光源阵列下拍摄,光源距相机中心30至40厘米。为支持端到端评估,数据集提供真值法向、真值网格、姿态及光与相机标定图像。我们评估了先进近场摄影立体算法,揭示其在不同材料和形状复杂度下的优劣。LUCES-MV为开发更鲁棒、准确、可扩展的真实摄影立体三维重建方法提供了重要基准。
原文摘要 · Abstract (English)
The biggest improvements in Photometric Stereo (PS) field has recently come from adoption of differentiable volumetric rendering techniques such as NeRF or Neural SDF achieving impressive reconstruction error of 0.2mm on DiLiGenT-MV benchmark. However, while there are sizeable datasets for environment lit objects such as Digital Twin Catalogue (DTS), there are only several small Photometric Stereo datasets which often lack challenging objects (simple, smooth, untextured) and practical, small form factor (near-field) light setup. To address this, we propose LUCES-MV, the first real-world, multi-view dataset designed for near-field point light source photometric stereo. Our dataset includes 15 objects with diverse materials, each imaged under varying light conditions from an array of 15 LEDs positioned 30 to 40 centimeters from the camera center. To facilitate transparent end-to-end evaluation, our dataset provides not only ground truth normals and ground truth object meshes and poses but also light and camera calibration images. We evaluate state-of-the-art near-field photometric stereo algorithms, highlighting their strengths and limitations across different material and shape complexities. LUCES-MV dataset offers an important benchmark for developing more robust, accurate and scalable real-world Photometric Stereo based 3D reconstruction methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。