针对水下图像不同区域的差异退化,提出自适应语义编码网络,提升增强效果。
Enhancing Underwater Images via Adaptive Semantic-aware Codebook Learning
- 基于语义感知的像素级离散码本,动态适配不同区域退化特征。
- 在多个基准上超越现有方法,参考与无参考指标均领先。
- 适合处理复杂水下场景,对颜色恢复和纹理细节优化显著。
水下图像增强(UIE)是一个病态问题,缺乏自然清晰的参考图像,且退化程度在不同语义区域间差异显著。现有方法采用单一全局模型,忽略了场景组件间的退化不一致性,导致在异质水下场景中出现明显色彩失真和细节丢失。为此,我们提出SUCode(语义感知水下码本网络),通过语义感知的离散码本表示实现自适应增强。相较于单次码本方法,SUCode利用语义感知、像素级码本表示,针对异质水下退化进行建模。采用三阶段训练范式,将原始水下图像特征表示,避免伪真值污染。门控通道注意力模块(GCAM)与频域感知特征融合(FAFF)协同整合通道与频率线索,实现精准色彩恢复与纹理重建。在多个基准上的大量实验表明,SUCode在参考与无参考指标上均达到当前最优性能。代码将公开于https://github.com/oucailab/SUCode。
原文摘要 · Abstract (English)
Underwater Image Enhancement (UIE) is an ill-posed problem where natural clean references are not available, and the degradation levels vary significantly across semantic regions. Existing UIE methods treat images with a single global model and ignore the inconsistent degradation of different scene components. This oversight leads to significant color distortions and loss of fine details in heterogeneous underwater scenes, especially where degradation varies significantly across different image regions. Therefore, we propose SUCode (Semantic-aware Underwater Codebook Network), which achieves adaptive UIE from semantic-aware discrete codebook representation. Compared with one-shot codebook-based methods, SUCode exploits semantic-aware, pixel-level codebook representation tailored to heterogeneous underwater degradation. A three-stage training paradigm is employed to represent raw underwater image features to avoid pseudo ground-truth contamination. Gated Channel Attention Module (GCAM) and Frequency-Aware Feature Fusion (FAFF) jointly integrate channel and frequency cues for faithful color restoration and texture recovery. Extensive experiments on multiple benchmarks demonstrate that SUCode achieves state-of-the-art performance, outperforming recent UIE methods on both reference and no-reference metrics. The code will be made public available at https://github.com/oucailab/SUCode.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。