用物理先验+深度学习,单次拍摄高精度重建复杂镜面三维结构。
Physics-informed Active Polarimetric 3D Imaging for Specular Surfaces
- 融合偏振信息与物理模型,通过双编码器动态调制特征解耦非线性耦合。
- 单次成像即可实现复杂镜面表面法向估计,精度显著优于传统方法。
- 适合工业在线检测、手持扫描等动态场景下的快速高精度三维成像。
真实场景中复杂镜面的三维成像仍具挑战,如在线检测或手持扫描,需在动态环境下快速准确测量复杂几何结构。光学量测技术如斜率测量法虽精度高,但通常依赖多帧采集,难以适应动态环境。基于傅里叶的单帧方法缓解了此问题,但在高空间频率结构或大曲率表面时性能下降。而计算机视觉中的偏振三维成像为单帧方式,对几何复杂度具有鲁棒性,但其精度受正交成像假设限制。本文提出一种物理引导的深度学习框架,用于复杂镜面的单帧三维成像。偏振线索提供方向先验,辅助解析结构光照编码的几何信息。通过双编码器架构与相互特征调制,网络可有效处理二者非线性耦合,直接推断表面法向。所提方法在单帧下实现高精度、强鲁棒性的法向估计,支持复杂镜面的实用三维成像。
原文摘要 · Abstract (English)
3D imaging of specular surfaces remains challenging in real-world scenarios, such as in-line inspection or hand-held scanning, requiring fast and accurate measurement of complex geometries. Optical metrology techniques such as deflectometry achieve high accuracy but typically rely on multi-shot acquisition, making them unsuitable for dynamic environments. Fourier-based single-shot approaches alleviate this constraint, yet their performance deteriorates when measuring surfaces with high spatial frequency structure or large curvature. Alternatively, polarimetric 3D imaging in computer vision operates in a single-shot fashion and exhibits robustness to geometric complexity. However, its accuracy is fundamentally limited by the orthographic imaging assumption. In this paper, we propose a physics-informed deep learning framework for single-shot 3D imaging of complex specular surfaces. Polarization cues provide orientation priors that assist in interpreting geometric information encoded by structured illumination. These complementary cues are processed through a dual-encoder architecture with mutual feature modulation, allowing the network to resolve their nonlinear coupling and directly infer surface normals. The proposed method achieves accurate and robust normal estimation in single-shot with fast inference, enabling practical 3D imaging of complex specular surfaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。