arXiv:2501.02701cs.CV2025-01中稿 · IEEE TCSVT被引 74

提出多尺度水下图像修复框架,有效恢复色彩与细节。

Underwater Image Restoration Through a Prior Guided Hybrid Sense Approach and Extensive Benchmark Analysis

  • 分层设计细节恢复与上下文建模模块,融合多尺度感知。
  • 在3个配对和3个非配对测试集上超越37种主流方法。
  • 构建首个综合性水下图像修复基准,适合算法对比研究。

水下成像受光-水相互作用影响,导致色彩失真和清晰度下降。为此,本文提出一种基于色彩平衡先验引导的混合感知水下图像修复框架(GuidedHybSensUIR)。该框架在多尺度上运行:细粒度尺度使用提出的细节恢复模块还原低级细节特征;粗粒度尺度采用特征上下文模块捕捉高级特征的长程依赖关系。通过融合不同尺度的感知能力,有效消除色偏并恢复模糊细节。为指导模型演进方向,引入新颖的色彩平衡先验,在特征上下文阶段作为强引导,解码阶段作为弱引导。构建涵盖三个真实水下数据集配对训练数据的综合基准,评估在六个测试集(含三个配对、三个非配对)上的表现,均来自四个真实水下数据集。在此基准上测试14种传统方法及23种重训练深度学习方法,获得各方法的量化结果。实验表明,本方法在多个基准数据集和指标上整体优于37种先进方法,尽管个别情况下未达最优。代码与数据集已公开于 https://github.com/CXH-Research/GuidedHybSensUIR。

原文摘要 · Abstract (English)

Underwater imaging grapples with challenges from light-water interactions, leading to color distortions and reduced clarity. In response to these challenges, we propose a novel Color Balance Prior \textbf{Guided} \textbf{Hyb}rid \textbf{Sens}e \textbf{U}nderwater \textbf{I}mage \textbf{R}estoration framework (\textbf{GuidedHybSensUIR}). This framework operates on multiple scales, employing the proposed \textbf{Detail Restorer} module to restore low-level detailed features at finer scales and utilizing the proposed \textbf{Feature Contextualizer} module to capture long-range contextual relations of high-level general features at a broader scale. The hybridization of these different scales of sensing results effectively addresses color casts and restores blurry details. In order to effectively point out the evolutionary direction for the model, we propose a novel \textbf{Color Balance Prior} as a strong guide in the feature contextualization step and as a weak guide in the final decoding phase. We construct a comprehensive benchmark using paired training data from three real-world underwater datasets and evaluate on six test sets, including three paired and three unpaired, sourced from four real-world underwater datasets. Subsequently, we tested 14 traditional and retrained 23 deep learning existing underwater image restoration methods on this benchmark, obtaining metric results for each approach. This effort aims to furnish a valuable benchmarking dataset for standard basis for comparison. The extensive experiment results demonstrate that our method outperforms 37 other state-of-the-art methods overall on various benchmark datasets and metrics, despite not achieving the best results in certain individual cases. The code and dataset are available at \href{https://github.com/CXH-Research/GuidedHybSensUIR}{https://github.com/CXH-Research/GuidedHybSensUIR}.

水下图像图像修复多尺度基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。