用扩散模型先验提升无配对图像去雾效果
Exploiting Diffusion Prior for Real-World Image Dehazing with Unpaired Training
- 引入扩散模型作为双向映射学习器,增强特征表示
- 融合物理先验,提升真实场景泛化能力
- 适用于复杂雾霾场景,适合图像恢复研究者
无配对训练已被证实是真实场景去雾的有效范式,通过学习无配对的真实雾霾与清晰图像实现。尽管已有大量研究,但现有方法在多样真实场景中泛化能力仍受限,主要因特征表示不足和真实世界先验利用不充分。受扩散模型生成雾霾与清晰图像强大能力的启发,本文提出一种名为 Diff-Dehazer 的无配对框架,利用扩散先验作为 CycleGAN 中的双射映射学习器。考虑到物理先验包含真实数据的关键统计信息,进一步通过整合物理先验挖掘真实世界知识。此外,通过消除图像与文本模态中的退化,从新视角充分挖掘扩散模型的表征能力,从而提升去雾效果。在多个真实世界数据集上的大量实验表明,本方法性能显著优于现有方法。
原文摘要 · Abstract (English)
Unpaired training has been verified as one of the most effective paradigms for real scene dehazing by learning from unpaired real-world hazy and clear images. Although numerous studies have been proposed, current methods demonstrate limited generalization for various real scenes due to limited feature representation and insufficient use of real-world prior. Inspired by the strong generative capabilities of diffusion models in producing both hazy and clear images, we exploit diffusion prior for real-world image dehazing, and propose an unpaired framework named Diff-Dehazer. Specifically, we leverage diffusion prior as bijective mapping learners within the CycleGAN, a classic unpaired learning framework. Considering that physical priors contain pivotal statistics information of real-world data, we further excavate real-world knowledge by integrating physical priors into our framework. Furthermore, we introduce a new perspective for adequately leveraging the representation ability of diffusion models by removing degradation in image and text modalities, so as to improve the dehazing effect. Extensive experiments on multiple real-world datasets demonstrate the superior performance of our method. Our code https://github.com/ywxjm/Diff-Dehazer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。