arXiv:2412.18459cs.CVeess.IV2024-12中稿 · ICASSP2025被引 46

用轻量级大核CNN实现水下图像修复,效果媲美复杂模型。

Underwater Image Restoration via Polymorphic Large Kernel CNNs

  • 设计多形态大卷积核捕捉水下图像长程依赖。
  • 引入频域与空域混合注意力,提升特征表达能力。
  • 纯CNN架构兼顾性能与效率,适合实际部署。

水下图像修复(UIR)因水下环境复杂的退化特性而极具挑战。尽管近期方法借助Transformer及参数庞大的模型取得显著进展,本文表明仅用轻量级参数的纯卷积神经网络亦可达到相当效果。提出一种名为UIR-PolyKernel的新方法,利用多形态大卷积核组合,有效捕捉水下图像中的长程依赖关系。同时引入混合域注意力模块,融合频域与空域注意力机制,增强特征重要性表达。通过频域分析,可挖掘人类难以察觉但对识别水下与空中图像模式至关重要的隐藏特征,从而提升模型泛化与鲁棒性。在多个基准数据集上的实验表明,UIR-PolyKernel在定量与定性指标上均达当前最优水平。结果证明,精心设计的纯CNN架构可有效竞争于更复杂模型,兼顾性能与计算效率。本工作为水下图像修复任务中基于CNN的潜力提供了新见解。代码已开源。

原文摘要 · Abstract (English)

Underwater Image Restoration (UIR) remains a challenging task in computer vision due to the complex degradation of images in underwater environments. While recent approaches have leveraged various deep learning techniques, including Transformers and complex, parameter-heavy models to achieve significant improvements in restoration effects, we demonstrate that pure CNN architectures with lightweight parameters can achieve comparable results. In this paper, we introduce UIR-PolyKernel, a novel method for underwater image restoration that leverages Polymorphic Large Kernel CNNs. Our approach uniquely combines large kernel convolutions of diverse sizes and shapes to effectively capture long-range dependencies within underwater imagery. Additionally, we introduce a Hybrid Domain Attention module that integrates frequency and spatial domain attention mechanisms to enhance feature importance. By leveraging the frequency domain, we can capture hidden features that may not be perceptible to humans but are crucial for identifying patterns in both underwater and on-air images. This approach enhances the generalization and robustness of our UIR model. Extensive experiments on benchmark datasets demonstrate that UIR-PolyKernel achieves state-of-the-art performance in underwater image restoration tasks, both quantitatively and qualitatively. Our results show that well-designed pure CNN architectures can effectively compete with more complex models, offering a balance between performance and computational efficiency. This work provides new insights into the potential of CNN-based approaches for challenging image restoration tasks in underwater environments. The code is available at \href{https://github.com/CXH-Research/UIR-PolyKernel}{https://github.com/CXH-Research/UIR-PolyKernel}.

图像修复水下视觉卷积网络注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。