用学习方法优化光照配置,让三维重建更准更快
LIPIDS: Learning-based Illumination Planning In Discretized (Light) Space for Photometric Stereo
- 设计神经网络自动选最优光照方向
- 在少至3个光源时精度接近最佳光照方案
- 适合做高精度三维扫描的科研与工程人员
光度立体术可通过不同光照下的图像获取物体表面法向。尽管已有方法在1到100个光照条件下表现良好,但很少关注如何学习最优光照配置。由于光照方向空间巨大,穷举采样不现实。现有数据集仅稀疏采样有限光照方向。本文提出LIPIDS——基于学习的离散光照空间照明规划方法,通过光照采样网络(LSNet)在固定光源数下最小化法向损失,优化光照方向。所学配置可直接用于推理,配合通用光度立体方法即可估计表面法向。在合成与真实数据集上的大量实验表明,使用LIPIDS生成的光照配置,在不同光度立体骨干模型上性能均优于或接近现有规划方法。
原文摘要 · Abstract (English)
Photometric stereo is a powerful method for obtaining per-pixel surface normals from differently illuminated images of an object. While several methods address photometric stereo with different image (or light) counts ranging from one to two to a hundred, very few focus on learning optimal lighting configuration. Finding an optimal configuration is challenging due to the vast number of possible lighting directions. Moreover, exhaustively sampling all possibilities is impractical due to time and resource constraints. Photometric stereo methods have demonstrated promising performance on existing datasets, which feature limited light directions sparsely sampled from the light space. Therefore, can we optimally utilize these datasets for illumination planning? In this work, we introduce LIPIDS - Learning-based Illumination Planning In Discretized light Space to achieve minimal and optimal lighting configurations for photometric stereo under arbitrary light distribution. We propose a Light Sampling Network (LSNet) that optimizes lighting direction for a fixed number of lights by minimizing the normal loss through a normal regression network. The learned light configurations can directly estimate surface normals during inference, even using an off-the-shelf photometric stereo method. Extensive qualitative and quantitative analyses on synthetic and real-world datasets show that photometric stereo under learned lighting configurations through LIPIDS either surpasses or is nearly comparable to existing illumination planning methods across different photometric stereo backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。