arXiv:2502.01522cs.CV2025-02被引 4

无需成对数据,用分解模糊模式提升图像去模糊泛化能力

Unpaired Deblurring via Decoupled Diffusion Model

  • 分离结构特征与模糊模式,通过三任务联合训练
  • 在真实数据集上优于现有方法,对未知模糊模式泛化性强
  • 适合缺乏配对数据的真实场景去模糊任务

基于大规模数据训练的生成扩散模型在图像合成方面取得显著进展。由于其能补全缺失细节并生成美观内容,近期工作通过在模糊-清晰图像对上训练适配器,为修复提供结构条件。然而,在真实场景中获取大量真实配对数据既困难又昂贵。仅依赖合成数据则易过拟合,导致面对未见模糊模式时表现不佳。为此,我们提出UID-Diff,一种基于生成扩散的模型,通过解耦结构特征与模糊模式,在三个特定设计任务上联合训练,以增强对未知域的去模糊性能。采用两个Q-Formers分别提取结构特征和模糊模式,前者用于合成数据上的监督去模糊任务,后者用于利用目标域未配对模糊图像的无监督模糊迁移任务。此外引入重建任务,使特征与模式相互补充。这种解耦学习过程提升了模型在未知模糊模式下的泛化能力。在真实世界数据集上的实验表明,UID-Diff在多种挑战性场景下均优于现有最先进方法,有效去除模糊并保留结构细节。

原文摘要 · Abstract (English)

Generative diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis. In favor of their ability to supplement missing details and generate aesthetically pleasing contents, recent works have applied them to image deblurring via training an adapter on blurry-sharp image pairs to provide structural conditions for restoration. However, acquiring substantial amounts of realistic paired data is challenging and costly in real-world scenarios. On the other hand, relying solely on synthetic data often results in overfitting, leading to unsatisfactory performance when confronted with unseen blur patterns. To tackle this issue, we propose UID-Diff, a generative-diffusion-based model designed to enhance deblurring performance on unknown domains by decoupling structural features and blur patterns through joint training on three specially designed tasks. We employ two Q-Formers as structural features and blur patterns extractors separately. The features extracted by them will be used for the supervised deblurring task on synthetic data and the unsupervised blur-transfer task by leveraging unpaired blurred images from the target domain simultaneously. We further introduce a reconstruction task to make the structural features and blur patterns complementary. This blur-decoupled learning process enhances the generalization capabilities of UID-Diff when encountering unknown blur patterns. Experiments on real-world datasets demonstrate that UID-Diff outperforms existing state-of-the-art methods in blur removal and structural preservation in various challenging scenarios.

图像去模糊扩散模型无配对数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。