用扩散模型生成逼真雾霾图,再快速去雾,提升真实场景去雾效果。
Learning Hazing to Dehazing: Towards Realistic Haze Generation for Real-World Image Dehazing
- 用预训练文生图模型生成逼真雾霾图像作为训练数据。
- 去雾部分仅需少量采样步骤即可还原清晰图像,速度快且保真度高。
- 适合需要高质量真实去雾的视觉任务,如自动驾驶、遥感图像处理。
现有真实场景去雾方法多依赖预训练模型微调或调整推理流程,对预训练数据依赖性强。在浓雾条件下恢复被严重扭曲的信息需使用生成式扩散模型,但其采样过程冗长,应用受限。为此,本文提出一种全新的「生雾-去雾」流水线:首先通过HazeGen框架利用预训练文本到图像扩散模型中的真实雾霾图像先验,结合混合训练与融合采样策略,生成多样且逼真的雾霾图像;随后,DiffDehazing框架采用加速保真采样过程(AccSamp),核心为分块统计对齐操作(AlignOp),可在极小采样步数内输出高质量去雾结果,显著降低复杂度并实现有效保真引导。大量实验表明,本方法在去雾性能和视觉质量上均优于现有方法。代码已开源。
原文摘要 · Abstract (English)
Existing real-world image dehazing methods primarily attempt to fine-tune pre-trained models or adapt their inference procedures, thus heavily relying on the pre-trained models and associated training data. Moreover, restoring heavily distorted information under dense haze requires generative diffusion models, whose potential in dehazing remains underutilized partly due to their lengthy sampling processes. To address these limitations, we introduce a novel hazing-dehazing pipeline consisting of a Realistic Hazy Image Generation framework (HazeGen) and a Diffusion-based Dehazing framework (DiffDehaze). Specifically, HazeGen harnesses robust generative diffusion priors of real-world hazy images embedded in a pre-trained text-to-image diffusion model. By employing specialized hybrid training and blended sampling strategies, HazeGen produces realistic and diverse hazy images as high-quality training data for DiffDehaze. To alleviate the inefficiency and fidelity concerns associated with diffusion-based methods, DiffDehaze adopts an Accelerated Fidelity-Preserving Sampling process (AccSamp). The core of AccSamp is the Tiled Statistical Alignment Operation (AlignOp), which can provide a clean and faithful dehazing estimate within a small fraction of sampling steps to reduce complexity and enable effective fidelity guidance. Extensive experiments demonstrate the superior dehazing performance and visual quality of our approach over existing methods. The code is available at https://github.com/ruiyi-w/Learning-Hazing-to-Dehazing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。