针对水下图像不同区域和波段的差异性退化,提出自适应双域增强方法。
Adaptive Dual-domain Learning for Underwater Image Enhancement
- 分空间与光谱两个维度,动态建模退化程度并自适应处理。
- 在多个数据集上优于现有方法,且计算成本更低。
- 适合需要高细节还原的水下视觉任务研究者使用。
基于学习的水下图像增强(UIE)方法近期表现优异,但仍面临两大挑战:一是未同时考虑不同空间区域和光谱波段的退化程度不一致问题;二是对所有区域一视同仁,忽略了高频细节区域更难重建的特性。为此,我们提出一种基于空间-光谱双域自适应学习的新型UIE方法——SS-UIE。具体而言,引入具有线性复杂度的空间级多尺度循环选择扫描(MCSS)模块和光谱级自注意力(SWSA)模块,并行组合形成基础的空间-光谱块(SS-block)。得益于MCSS和SWSA的全局感受野,该模块可有效建模不同空间区域与光谱波段的退化水平,实现基于退化程度的双域自适应增强。通过堆叠多个SS-block构建整体网络。此外,设计频率级损失(FWL),缩小频域差异,强化模型对高频细节区域的关注。大量实验验证,SS-UIE在多个基准数据集上超越当前最优方法,同时计算与内存开销更低。
原文摘要 · Abstract (English)
Recently, learning-based Underwater Image Enhancement (UIE) methods have demonstrated promising performance. However, existing learning-based methods still face two challenges. 1) They rarely consider the inconsistent degradation levels in different spatial regions and spectral bands simultaneously. 2) They treat all regions equally, ignoring that the regions with high-frequency details are more difficult to reconstruct. To address these challenges, we propose a novel UIE method based on spatial-spectral dual-domain adaptive learning, termed SS-UIE. Specifically, we first introduce a spatial-wise Multi-scale Cycle Selective Scan (MCSS) module and a Spectral-Wise Self-Attention (SWSA) module, both with linear complexity, and combine them in parallel to form a basic Spatial-Spectral block (SS-block). Benefiting from the global receptive field of MCSS and SWSA, SS-block can effectively model the degradation levels of different spatial regions and spectral bands, thereby enabling degradation level-based dual-domain adaptive UIE. By stacking multiple SS-blocks, we build our SS-UIE network. Additionally, a Frequency-Wise Loss (FWL) is introduced to narrow the frequency-wise discrepancy and reinforce the model's attention on the regions with high-frequency details. Extensive experiments validate that the SS-UIE technique outperforms state-of-the-art UIE methods while requiring cheaper computational and memory costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。