融合物理模型与数据驱动,提升水下图像增强效果
DPF-Net: Physical Imaging Model Embedded Data-Driven Underwater Image Enhancement
- 用合成数据训练物理参数估计模块,确保参数可信
- 在多个测试集上超越现有方法,实现当前最优性能
- 适合需要高保真水下图像处理的研究与应用
由于水下环境中光吸收与散射的复杂相互作用,水下图像严重退化。本文提出一种两阶段水下图像增强网络 DPF-Net,结合物理成像模型的稳健性与数据驱动方法的泛化性和高效性。首先利用合成数据集训练物理参数估计模块,确保物理参数的可靠性,而非仅通过成像方程学习原始图像与参考图像间的拟合关系。该模块随后与增强网络联合训练,将估计的物理参数嵌入数据驱动模型的嵌入空间。为保持水下成像退化下的恢复过程一致性,提出基于物理的退化一致性损失。此外,设计一种利用全数据集的弱参考损失项,降低模型对单个参考图像质量的依赖。DPF-Net 在多个测试集上表现优异,达到当前最优结果。源代码与预训练模型已公开于项目主页:https://github.com/OUCVisionGroup/DPF-Net。
原文摘要 · Abstract (English)
Due to the complex interplay of light absorption and scattering in the underwater environment, underwater images experience significant degradation. This research presents a two-stage underwater image enhancement network called the Data-Driven and Physical Parameters Fusion Network (DPF-Net), which harnesses the robustness of physical imaging models alongside the generality and efficiency of data-driven methods. We first train a physical parameter estimate module using synthetic datasets to guarantee the trustworthiness of the physical parameters, rather than solely learning the fitting relationship between raw and reference images by the application of the imaging equation, as is common in prior studies. This module is subsequently trained in conjunction with an enhancement network, where the estimated physical parameters are integrated into a data-driven model within the embedding space. To maintain the uniformity of the restoration process amid underwater imaging degradation, we propose a physics-based degradation consistency loss. Additionally, we suggest an innovative weak reference loss term utilizing the entire dataset, which alleviates our model's reliance on the quality of individual reference images. Our proposed DPF-Net demonstrates superior performance compared to other benchmark methods across multiple test sets, achieving state-of-the-art results. The source code and pre-trained models are available on the project home page: https://github.com/OUCVisionGroup/DPF-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。