用旋转光源+事件相机实现无需标定的高动态表面重建
Event-based Photometric Stereo via Rotating Illumination and Per-Pixel Learning
- 用单光源旋转+事件相机捕捉亮度变化,免去多光源同步
- 在基准数据集上比现有方法平均角度误差降低7.12%
- 对稀疏事件、强环境光、镜面反射均表现鲁棒,适合真实场景
光度立体法通过不同光照下的图像估计表面法向。传统帧基方法受限于可控光照和环境光干扰,在真实场景中应用受限。为此,我们提出一种基于事件相机的光度立体系统,适用于连续变化辐射和高动态范围场景。系统采用单个光源沿预设圆形轨迹旋转,无需多个同步光源,设计更紧凑可扩展。我们进一步引入轻量级逐像素多层神经网络,直接从光源旋转时产生的事件信号预测表面法向,无需系统标定。在基准数据集及自建真实数据上的实验表明,该方法相比现有事件基光度立体方法平均角度误差降低7.12%。同时,在事件稀疏区域、强环境光及镜面反射场景中也表现出良好鲁棒性。
原文摘要 · Abstract (English)
Photometric stereo is a technique for estimating surface normals using images captured under varying illumination. However, conventional frame-based photometric stereo methods are limited in real-world applications due to their reliance on controlled lighting, and susceptibility to ambient illumination. To address these limitations, we propose an event-based photometric stereo system that leverages an event camera, which is effective in scenarios with continuously varying scene radiance and high dynamic range conditions. Our setup employs a single light source moving along a predefined circular trajectory, eliminating the need for multiple synchronized light sources and enabling a more compact and scalable design. We further introduce a lightweight per-pixel multi-layer neural network that directly predicts surface normals from event signals generated by intensity changes as the light source rotates, without system calibration. Experimental results on benchmark datasets and real-world data collected with our data acquisition system demonstrate the effectiveness of our method, achieving a 7.12\% reduction in mean angular error compared to existing event-based photometric stereo methods. In addition, our method demonstrates robustness in regions with sparse event activity, strong ambient illumination, and scenes affected by specularities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。