arXiv:2511.21132cs.CV2025-11

通过傅里叶域学习模糊核,实现更精准的图像去模糊。

DeepRFTv2: Kernel-level Learning for Image Deblurring

  • 在傅里叶空间将卷积转为乘法,实现低复杂度核级建模。
  • 用特征而非图像作为卷积对象,提升模糊本质学习效果。
  • 多尺度可逆结构降低显存占用,适合实际部署。

众所周知,若网络要实现去模糊,必须理解模糊过程。模糊本质上是清晰图像与模糊核的卷积。当前深度网络仍停留在像素级学习阶段,或端到端像素恢复,或分阶段伪核级重建,未能真正理解模糊本质。为此,我们提出傅里叶核估计器(FKE),利用傅里叶域激活操作,将空间域卷积转化为频域乘法,联合优化去模糊模型,实现低复杂度无监督核级学习。进一步,将核的卷积对象从图像改为网络提取的特征,其蕴含的语义与结构信息更适于模糊过程建模。通过特征与估计核的卷积,模型可学习模糊的本质。为提升特征提取效率,设计解耦多尺度架构,采用多层级子编解码器与可逆策略,实现低内存下的高效多尺度编码解码。大量实验表明,本方法在运动去模糊上达到当前最优性能,并展现出处理其他核相关问题的潜力。分析显示,我们的核估计器能学习出物理上合理的核。

原文摘要 · Abstract (English)

It is well-known that if a network aims to learn how to deblur, it should understand the blur process. Blurring is naturally caused by the convolution of the sharp image with the blur kernel. Thus, allowing the network to learn the blur process in the kernel-level can significantly improve the image deblurring performance. But, current deep networks are still at the pixel-level learning stage, either performing end-to-end pixel-level restoration or stage-wise pseudo kernel-level restoration, failing to enable the deblur model to understand the essence of the blur. To this end, we propose Fourier Kernel Estimator (FKE), which considers the activation operation in Fourier space and converts the convolution problem in the spatial domain to a multiplication problem in Fourier space. Our FKE, jointly optimized with the deblur model, enables the network to learn the kernel-level blur process with low complexity and without any additional supervision. Furthermore, we change the convolution object of the kernel from ``image" to network extracted ``feature", whose rich semantic and structural information is more suitable to blur process learning. With the convolution of the feature and the estimated kernel, our model can learn the essence of blur in kernel-level. To further improve the efficiency of feature extraction, we design a decoupled multi-scale architecture with multiple hierarchical sub-unets with a reversible strategy, which allows better multi-scale encoding and decoding in low training memory. Extensive experiments indicate that our method achieves state-of-the-art motion deblurring results and show potential for handling other kernel-related problems. Analysis also shows our kernel estimator is able to learn physically meaningful kernels. The code will be available at https://github.com/DeepMed-Lab-ECNU/Single-Image-Deblur.

图像去模糊傅里叶变换核估计多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。