用物理模型指导扩散过程,让合成数据训练的去雾模型更好适应真实场景。
Physics-Guided Image Dehazing Diffusion
- 将大气散射模型融入扩散过程,模拟渐进式雾霾生成。
- 在合成数据上训练,仍能有效还原真实雾天图像。
- 适合需要跨域泛化的图像去雾任务,尤其对真实场景优化
由于真实世界与合成雾图之间存在领域差异,当前基于数据驱动的去雾算法在合成数据上表现良好,但在真实场景中泛化能力差。为此,我们提出图像去雾扩散模型(IDDM),一种将大气散射模型融入噪声扩散过程的新方法。IDDM利用渐进式雾霾形成过程,帮助去噪Unet从条件输入的雾图中稳健学习清晰图像的分布。设计了以IDDM为核心的专用训练策略:扩散模型用于弥合合成到真实世界的领域差距,而大气散射模型提供雾霾生成的物理引导。前向过程中,IDDM同时向清晰图像添加雾霾和噪声;采样时则能稳健分离二者。通过引入物理引导信息进行训练,IDDM具备良好的领域泛化能力,即使仅在合成数据上训练,也能有效恢复真实雾图。大量实验表明,该方法在定量与定性对比中均优于现有先进方法。
原文摘要 · Abstract (English)
Due to the domain gap between real-world and synthetic hazy images, current data-driven dehazing algorithms trained on synthetic datasets perform well on synthetic data but struggle to generalize to real-world scenarios. To address this challenge, we propose \textbf{I}mage \textbf{D}ehazing \textbf{D}iffusion \textbf{M}odels (IDDM), a novel diffusion process that incorporates the atmospheric scattering model into noise diffusion. IDDM aims to use the gradual haze formation process to help the denoising Unet robustly learn the distribution of clear images from the conditional input hazy images. We design a specialized training strategy centered around IDDM. Diffusion models are leveraged to bridge the domain gap from synthetic to real-world, while the atmospheric scattering model provides physical guidance for haze formation. During the forward process, IDDM simultaneously introduces haze and noise into clear images, and then robustly separates them during the sampling process. By training with physics-guided information, IDDM shows the ability of domain generalization, and effectively restores the real-world hazy images despite being trained on synthetic datasets. Extensive experiments demonstrate the effectiveness of our method through both quantitative and qualitative comparisons with state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。