arXiv:2507.13599cs.CV2025-07ICCV被引 4

用扩散模型从无配对数据学习纹理先验,实现无需成对数据的图像去模糊。

Learning Deblurring Texture Prior from Unpaired Data with Diffusion Model

  • 通过扩散模型生成空间变化的纹理先验,指导去模糊过程。
  • 在多个基准上超越当前最优方法,尤其在真实模糊场景下表现突出。
  • 适合研究无监督图像恢复、扩散模型应用的开发者与学者。

由于获取大量真实模糊-清晰图像对困难且成本高,从无配对数据中学习盲去模糊更具实用性和前景。然而,主流方法高度依赖对抗学习来弥合模糊域与清晰域之间的差距,忽略了真实世界模糊模式的复杂性和不可预测性。本文提出一种基于扩散模型(DM)的新框架 extit{ours},通过从无配对数据中学习空间变化的纹理先验来实现图像去模糊。具体而言, extit{ours} 利用扩散模型生成有助于恢复模糊图像纹理的先验知识。为此,我们设计了纹理先验编码器(TPE),引入记忆机制表示图像纹理,并为扩散模型训练提供监督。为充分挖掘生成的纹理先验,提出纹理迁移变换层(TTformer),其中新型滤波调制多头自注意力(FM-MSA)通过自适应滤波有效去除空间变化的模糊。此外,采用基于小波的对抗损失以保留高频纹理细节。大量实验表明, extit{ours} 提供了一种有前景的无监督去模糊方案,在多个常用基准上优于当前最优方法。

原文摘要 · Abstract (English)

Since acquiring large amounts of realistic blurry-sharp image pairs is difficult and expensive, learning blind image deblurring from unpaired data is a more practical and promising solution. Unfortunately, dominant approaches rely heavily on adversarial learning to bridge the gap from blurry domains to sharp domains, ignoring the complex and unpredictable nature of real-world blur patterns. In this paper, we propose a novel diffusion model (DM)-based framework, dubbed \ours, for image deblurring by learning spatially varying texture prior from unpaired data. In particular, \ours performs DM to generate the prior knowledge that aids in recovering the textures of blurry images. To implement this, we propose a Texture Prior Encoder (TPE) that introduces a memory mechanism to represent the image textures and provides supervision for DM training. To fully exploit the generated texture priors, we present the Texture Transfer Transformer layer (TTformer), in which a novel Filter-Modulated Multi-head Self-Attention (FM-MSA) efficiently removes spatially varying blurring through adaptive filtering. Furthermore, we implement a wavelet-based adversarial loss to preserve high-frequency texture details. Extensive evaluations show that \ours provides a promising unsupervised deblurring solution and outperforms SOTA methods in widely-used benchmarks.

图像去模糊扩散模型无监督学习纹理先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。