分两阶段增强水下图像,用对比学习逐步提升效果
Underwater Image Enhancement with Cascaded Contrastive Learning
- 分颜色校正和去雾两阶段,逐步优化图像
- 每阶段用对比损失确保输出优于前一阶段结果
- 在多个数据集上优于现有方法,适合水下视觉研究
水下图像增强(UIE)因水下环境复杂、退化类型多样而极具挑战。尽管深度学习已推动该领域显著进展,但多数现有方法采用单阶段网络,难以同时处理多种退化问题。本文提出一种两阶段深度学习框架,利用级联对比学习引导各阶段训练,命名为CCL-Net。该方法包含两个级联阶段:第一阶段专注解决颜色偏差,第二阶段专注于提升可见度与对比度。为保证图像逐级优化,设计双重对比损失:第一阶段以原始水下图像作为负样本,确保颜色校正后结果优于输入;第二阶段以第一阶段的中间结果为负样本,确保最终去雾结果优于中间输出。在多个基准数据集上的大量实验表明,CCL-Net性能优于众多先进方法。代码将开源于https://github.com/lewis081/CCL-Net。
原文摘要 · Abstract (English)
Underwater image enhancement (UIE) is a highly challenging task due to the complexity of underwater environment and the diversity of underwater image degradation. Due to the application of deep learning, current UIE methods have made significant progress. Most of the existing deep learning-based UIE methods follow a single-stage network which cannot effectively address the diverse degradations simultaneously. In this paper, we propose to address this issue by designing a two-stage deep learning framework and taking advantage of cascaded contrastive learning to guide the network training of each stage. The proposed method is called CCL-Net in short. Specifically, the proposed CCL-Net involves two cascaded stages, i.e., a color correction stage tailored to the color deviation issue and a haze removal stage tailored to improve the visibility and contrast of underwater images. To guarantee the underwater image can be progressively enhanced, we also apply contrastive loss as an additional constraint to guide the training of each stage. In the first stage, the raw underwater images are used as negative samples for building the first contrastive loss, ensuring the enhanced results of the first color correction stage are better than the original inputs. While in the second stage, the enhanced results rather than the raw underwater images of the first color correction stage are used as the negative samples for building the second contrastive loss, thus ensuring the final enhanced results of the second haze removal stage are better than the intermediate color corrected results. Extensive experiments on multiple benchmark datasets demonstrate that our CCL-Net can achieve superior performance compared to many state-of-the-art methods. The source code of CCL-Net will be released at https://github.com/lewis081/CCL-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。