arXiv:2503.17937cs.CV2025-03

跨域水下图像增强新方法,用无参考质量评估提升效果

Cross-Domain Underwater Image Enhancement Guided by No-Reference Image Quality Assessment: A Transfer Learning Approach

  • 通过预训练+迁移学习捕捉水下图像增强本质规律
  • 结合无参考质量评估指标,跨域生成更自然的图像
  • 适合水下视觉、海洋探测等领域的研究人员

单张水下图像增强是极具挑战性的病态问题,其发展受两大瓶颈制约:(1) 水下参考数据集的标签为伪标签,依赖此类伪真值进行监督学习会引发域偏差;(2) 水下参考数据集稀缺,小样本训练易导致过拟合与分布偏移。为此,我们提出Trans-UIE,一种基于迁移学习的水下图像增强模型,通过在包含参考与非参考数据的混合数据集上进行微调,实现对水下图像增强核心范式的捕捉。然而,仅使用重建损失微调可能引入确认偏差。为此,我们的方法利用来自水上场景的无参考图像质量评估(NR-IQA)指标,在跨域生成过程中引导增强结果,使其具备水上图像风格。此外,为降低预训练阶段过拟合风险,引入皮尔逊相关性损失。在全参考与无参考水下基准数据集上的实验表明,Trans-UIE显著优于现有最先进方法。

原文摘要 · Abstract (English)

Single underwater image enhancement (UIE) is a challenging ill-posed problem, but its development is hindered by two major issues: (1) The labels in underwater reference datasets are pseudo labels, relying on these pseudo ground truths in supervised learning leads to domain discrepancy. (2) Underwater reference datasets are scarce, making training on such small datasets prone to overfitting and distribution shift. To address these challenges, we propose Trans-UIE, a transfer learning-based UIE model that captures the fundamental paradigms of UIE through pretraining and utilizes a dataset composed of both reference and non-reference datasets for fine-tuning. However, fine-tuning the model using only reconstruction loss may introduce confirmation bias. To mitigate this, our method leverages no-reference image quality assessment (NR-IQA) metrics from above-water scenes to guide the transfer learning process across domains while generating enhanced images with the style of the above-water image domain. Additionally, to reduce the risk of overfitting during the pretraining stage, we introduce Pearson correlation loss. Experimental results on both full-reference and no-reference underwater benchmark datasets demonstrate that Trans-UIE significantly outperforms state-of-the-art methods.

图像增强迁移学习无参考评估水下视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。