公开首个含真实与合成数据的光场深度估计数据集,支持算法开发与验证。
Light-Field Dataset for Disparity Based Depth Estimation
- 构建真实与合成光场图像数据集,涵盖285张真实图像和13张合成图像。
- 揭示焦距对视差的影响,指出现有数据集的局限性。
- 适合从事光场深度估计、三维重建的研究者使用。
光场相机在主镜头与传感器之间增加了一个二维微透镜阵列,使每个微透镜下的感光像素接收来自主镜头子孔径的光线,从而捕捉场景点的空间信息与角度分辨率。这种额外的角度信息可用于估计三维场景深度。光场数据中的连续虚拟视角可利用极线图像(EPIs)实现高效深度估计,并具备鲁棒的遮挡处理能力。然而,角度信息与空间信息之间的权衡至关重要,且受相机焦距位置影响显著。为设计、开发、实现和测试基于视差的光场深度估计算法,需要合适的光场图像数据集。本文介绍并详细描述了一个公开可用的光场图像数据集。该数据集包含285张使用Lytro Illum LF相机拍摄的真实光场图像和13张合成光场图像,其中合成数据具有与真实光场相机相似的视差特性。此外,还通过机械导轨系统与Blender创建了真实与合成双目光场数据集。数据集已开源:https://github.com/aupendu/light-field-dataset。
原文摘要 · Abstract (English)
A Light Field (LF) camera consists of an additional two-dimensional array of micro-lenses placed between the main lens and sensor, compared to a conventional camera. The sensor pixels under each micro-lens receive light from a sub-aperture of the main lens. This enables the image sensor to capture both spatial information and the angular resolution of a scene point. This additional angular information is used to estimate the depth of a 3-D scene. The continuum of virtual viewpoints in light field data enables efficient depth estimation using Epipolar Line Images (EPIs) with robust occlusion handling. However, the trade-off between angular information and spatial information is very critical and depends on the focal position of the camera. To design, develop, implement, and test novel disparity-based light field depth estimation algorithms, the availability of suitable light field image datasets is essential. In this paper, a publicly available light field image dataset is introduced and thoroughly described. We have also demonstrated the effect of focal position on the disparity of a 3-D point as well as the shortcomings of the currently available light field dataset. The proposed dataset contains 285 light field images captured using a Lytro Illum LF camera and 13 synthetic LF images. The proposed dataset also comprises a synthetic dataset with similar disparity characteristics to those of a real light field camera. A real and synthetic stereo light field dataset is also created by using a mechanical gantry system and Blender. The dataset is available at https://github.com/aupendu/light-field-dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。