用偏振信息同时去雾并重建水下三维法向,精度更高。
UD-SfPNet: An Underwater Descattering Shape-from-Polarization Network for 3D Normal Reconstruction
- 统一框架联合优化去雾与偏振形状重建,减少误差累积。
- 在MuS-Polar3D数据集上法向角误差低至15.12°,优于现有方法。
- 适合水下三维成像、海洋探测等复杂光学环境应用。
水下光学成像受散射严重干扰,而偏振成像兼具去雾与基于偏振的形状重建(SfP)优势。本文提出UD-SfPNet,一种融合偏振线索的水下去雾-形状重建网络。该框架在统一流程中联合建模偏振去雾与SfP法向估计,避免串行处理带来的误差累积,并实现跨任务全局优化。模型引入新颖的颜色嵌入模块,利用颜色编码与表面朝向的关系增强几何一致性;还设计细节增强卷积模块,更好保留散射下丢失的高频几何细节。在MuS-Polar3D数据集上的实验表明,该方法显著提升重建精度,平均表面法向角误差达15.12°,为对比方法中最低。结果验证了去雾与偏振形状推断结合的有效性,凸显了其在复杂水下光学三维成像中的实用价值与应用潜力。代码已开源。
原文摘要 · Abstract (English)
Underwater optical imaging is severely hindered by scattering, but polarization imaging offers the unique dual advantages of descattering and shape-from-polarization (SfP) 3D reconstruction. To exploit these advantages, this paper proposes UD-SfPNet, an underwater descattering shape-from-polarization network that leverages polarization cues for improved 3D surface normal prediction. The framework jointly models polarization-based image descattering and SfP normal estimation in a unified pipeline, avoiding error accumulation from sequential processing and enabling global optimization across both tasks. UD-SfPNet further incorporates a novel color embedding module to enhance geometric consistency by exploiting the relationship between color encodings and surface orientation. A detail enhancement convolution module is also included to better preserve high-frequency geometric details that are lost under scattering. Experiments on the MuS-Polar3D dataset show that the proposed method significantly improves reconstruction accuracy, achieving a mean surface normal angular error of 15.12$^\circ$ (the lowest among compared methods). These results confirm the efficacy of combining descattering with polarization-based shape inference, and highlight the practical significance and potential applications of UD-SfPNet for optical 3D imaging in challenging underwater environments. The code is available at https://github.com/WangPuyun/UD-SfPNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。