arXiv:2502.14209cs.CV2025-02被引 3

提出跨域自适应融合网络,同时利用空间与频率域信息提升图像去模糊效果。

Spatial and Frequency Domain Adaptive Fusion Network for Image Deblurring

  • 设计门控跨域特征融合模块,动态结合空间与频率信息。
  • 引入可学习低通滤波器,自适应分解特征至频带子空间。
  • 适合需要高精度图像恢复的研究者和工程应用开发者。

图像去模糊旨在从模糊图像中重建出清晰的原始图像。尽管现有方法已取得良好性能,但多数仅在空间域或频率域操作,很少融合双域优势。本文提出空间-频率域自适应融合网络(SFAFNet),通过设计门控空间-频率域特征融合模块(GSFFBlock),包含三个核心组件:空间域信息模块、频率域信息动态生成模块(FDGM)与门控融合模块(GFM)。空间域模块采用NAFBlock整合局部信息;在FDGM中,设计可学习低通滤波器,动态将特征分解为不同频率子带,捕捉全局感受野并实现对上下文信息的自适应探索。此外,在GFM中引入门控机制(GATE)对空间与频率特征进行重加权,并通过交叉注意力机制(CAM)完成融合,促进信息流动与互补表示学习。实验表明,SFAFNet在常用基准测试上优于当前主流方法。

原文摘要 · Abstract (English)

Image deblurring aims to reconstruct a latent sharp image from its corresponding blurred one. Although existing methods have achieved good performance, most of them operate exclusively in either the spatial domain or the frequency domain, rarely exploring solutions that fuse both domains. In this paper, we propose a spatial-frequency domain adaptive fusion network (SFAFNet) to address this limitation. Specifically, we design a gated spatial-frequency domain feature fusion block (GSFFBlock), which consists of three key components: a spatial domain information module, a frequency domain information dynamic generation module (FDGM), and a gated fusion module (GFM). The spatial domain information module employs the NAFBlock to integrate local information. Meanwhile, in the FDGM, we design a learnable low-pass filter that dynamically decomposes features into separate frequency subbands, capturing the image-wide receptive field and enabling the adaptive exploration of global contextual information. Additionally, to facilitate information flow and the learning of complementary representations. In the GFM, we present a gating mechanism (GATE) to re-weight spatial and frequency domain features, which are then fused through the cross-attention mechanism (CAM). Experimental results demonstrate that our SFAFNet performs favorably compared to state-of-the-art approaches on commonly used benchmarks.

图像去模糊跨域融合频率域注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。