用像素差卷积提升水下图像细节,让模糊画面更清晰
PDCFNet: Enhancing Underwater Images through Pixel Difference Convolution
- 引入像素差卷积捕捉图像梯度变化,强化高频纹理特征
- 在UIEB数据集上达到27.37的PSNR和92.02的SSIM,性能领先
- 适合图像增强、水下视觉研究者参考,代码已开源
多数深度学习方法采用标准卷积增强水下图像。尽管标准卷积擅长提取局部特征并学习空间层次结构,但容易使图像平滑,限制了特征表达与建模能力。水下退化图像的显著特征是模糊,增强目标在于提升纹理与细节(高频特征)的可见性。因此,我们提出利用高频特征可提升增强效果。为此,本文引入像素差卷积(PDC),聚焦于图像中梯度变化显著的区域,从而增强对细节的建模能力。基于此,设计了基于PDC与跨层级特征融合的水下图像增强网络——PDCFNet。具体而言,设计了基于PDC的细节增强模块,通过并行PDC捕捉高频特征,实现更好的纹理与细节增强;同时设计跨层级特征融合模块,通过拼接与乘法操作促进不同层级特征间的充分交互与增强。在UIEB数据集上,PDCFNet取得27.37的PSNR与92.02的SSIM,为当前最佳性能。代码已公开于https://github.com/zhangsong1213/PDCFNet。
原文摘要 · Abstract (English)
Majority of deep learning methods utilize vanilla convolution for enhancing underwater images. While vanilla convolution excels in capturing local features and learning the spatial hierarchical structure of images, it tends to smooth input images, which can somewhat limit feature expression and modeling. A prominent characteristic of underwater degraded images is blur, and the goal of enhancement is to make the textures and details (high-frequency features) in the images more visible. Therefore, we believe that leveraging high-frequency features can improve enhancement performance. To address this, we introduce Pixel Difference Convolution (PDC), which focuses on gradient information with significant changes in the image, thereby improving the modeling of enhanced images. We propose an underwater image enhancement network, PDCFNet, based on PDC and cross-level feature fusion. Specifically, we design a detail enhancement module based on PDC that employs parallel PDCs to capture high-frequency features, leading to better detail and texture enhancement. The designed cross-level feature fusion module performs operations such as concatenation and multiplication on features from different levels, ensuring sufficient interaction and enhancement between diverse features. Our proposed PDCFNet achieves a PSNR of 27.37 and an SSIM of 92.02 on the UIEB dataset, attaining the best performance to date. Our code is available at https://github.com/zhangsong1213/PDCFNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。