用偏振编码实现隐形单帧形状与反照率恢复
Spatial Polarization Multiplexing: Single-Shot Invisible Shape and Reflectance Recovery
- 通过偏振模式空间复用,同时编码入射光与反射光信息
- 单帧即可解耦漫反射与镜面反射,精确估计BRDF
- 适用于静态/动态物体,隐身特性拓展3D传感应用
本文提出空间偏振复用(SPM)方法,用于对静止或动态变形物体的形状与反照率进行联合感知,且对人眼不可见。传统结构光方法仅能获取形状,无法恢复反照率,因其会改变场景外观。本方法的核心思想是空间复用偏振图案,以编码入射光线并密集采样反射光。我们推导出一种可从反射光的线性偏振角(AoLP)值中鲁棒且唯一解码的量化偏振光模式,同时实现单帧下偏振漫反射与镜面反射的解耦,从而准确估计BRDF。该空间偏振复用通过受约束的德布鲁因序列实现。我们在真实静态与动态物体上验证了该方法的有效性。结果表明,SPM在精确测量形状与BRDF方面表现优异,因其隐形特性与联合恢复辐射属性的能力,为3D传感开辟了新应用路径。
原文摘要 · Abstract (English)
We propose spatial polarization multiplexing (SPM) for joint sensing of shape and reflectance of a static or dynamic deformable object, which is also invisible to the naked eye. Past structured-light methods are limited to shape acquisition and cannot recover reflectance as they alter scene appearance. Our key idea is to spatially multiplex a polarization pattern to encode the incident ray and also densely sample the reflected light. We derive a quantized polarized light pattern that can be robustly and uniquely decoded from the reflected Angle of Linear Polarization (AoLP) values. It also enables single-shot disentanglement of polarimetric diffuse and specular reflections for accurate BRDF estimation. We achieve this spatial polarization multiplexing (SPM) with a constrained de Bruijn sequence. We validate this novel invisible single-shot shape and reflectance method with real static and dynamic objects. The results demonstrate the effectiveness of SPM for accurate shape and BRDF measurement which opens new avenues of application for 3D sensing thanks to its invisibility and ability to jointly recover the radiometric properties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。