基于频域重建的扩散模型,有效提升无配对去雾效果
Frequency Domain-Based Diffusion Model for Unpaired Image Dehazing
- 从频域角度重构清晰图像幅度谱,利用扩散模型学习分布
- 设计幅度残差编码器,填补雾霾与清晰图像间的幅度差异
- 引入相位修正模块,简单注意力机制消除去雾伪影
由于训练数据要求灵活,无配对图像去雾受到越来越多关注。现有基于对比学习的方法不仅引入了与雾霾无关的内容信息,还忽略了频域中雾霾特有的属性(即雾霾退化主要体现在幅度谱上)。为此,我们提出一种新型频域扩散模型 exttt{ours},充分挖掘无配对清晰图像中的有益知识。受扩散模型强大生成能力启发,我们从频域重建视角解决去雾问题,通过扩散模型生成与清晰图像分布一致的幅度谱。为实现该目标,我们设计幅度残差编码器(ARE),用于提取幅度残差,有效补偿从雾霾到清晰域的幅度差距,并为扩散模型训练提供监督信号。此外,提出相位修正模块(PCM),通过简单的注意力机制在去雾过程中进一步优化相位谱,消除伪影。实验结果表明, exttt{ours} 在合成与真实世界数据集上均优于现有最先进方法。
原文摘要 · Abstract (English)
Unpaired image dehazing has attracted increasing attention due to its flexible data requirements during model training. Dominant methods based on contrastive learning not only introduce haze-unrelated content information, but also ignore haze-specific properties in the frequency domain (\ie,~haze-related degradation is mainly manifested in the amplitude spectrum). To address these issues, we propose a novel frequency domain-based diffusion model, named \ours, for fully exploiting the beneficial knowledge in unpaired clear data. In particular, inspired by the strong generative ability shown by Diffusion Models (DMs), we tackle the dehazing task from the perspective of frequency domain reconstruction and perform the DMs to yield the amplitude spectrum consistent with the distribution of clear images. To implement it, we propose an Amplitude Residual Encoder (ARE) to extract the amplitude residuals, which effectively compensates for the amplitude gap from the hazy to clear domains, as well as provide supervision for the DMs training. In addition, we propose a Phase Correction Module (PCM) to eliminate artifacts by further refining the phase spectrum during dehazing with a simple attention mechanism. Experimental results demonstrate that our \ours outperforms other state-of-the-art methods on both synthetic and real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。