用物理模型生成假晴图,让去雾网络更稳定、效果更好
Learning Unpaired Image Dehazing with Physics-based Rehazy Generation
- 基于物理模型构建真实雾霾与去雾图像对,提升训练可靠性
- 在SOTS-Indoor上比之前最佳方法高3.58 dB,SOTS-Outdoor高1.85 dB
- 适合需要高泛化能力的真实场景去雾任务
图像去雾中过度依赖合成数据对仍是一个关键挑战,导致对真实场景泛化能力差。现有方法虽采用无配对真实数据训练,使用CycleGAN或对比学习框架,但常因训练不稳定而性能受限。本文提出新型无配对去雾训练策略Rehazy,通过挖掘雾霾图像间潜在清晰图像的一致性,利用雾霾-去雾对有效学习真实雾霾特征。为此,我们设计了理论验证过的物理驱动去雾生成流程,可可靠生成高质量去雾图像。进一步,构建双分支网络:干净分支以合成方式提供基础去雾能力,雾霾分支则借助雾霾-去雾对增强泛化能力。同时设计新网络结构,实现从粗到细的渐进式清晰场景恢复。在四个基准测试上实验表明,本方法在SOTS-Indoor上优于前人最佳方法3.58 dB(PSNR),在SOTS-Outdoor上高1.85 dB。代码将公开。
原文摘要 · Abstract (English)
Overfitting to synthetic training pairs remains a critical challenge in image dehazing, leading to poor generalization capability to real-world scenarios. To address this issue, existing approaches utilize unpaired realistic data for training, employing CycleGAN or contrastive learning frameworks. Despite their progress, these methods often suffer from training instability, resulting in limited dehazing performance. In this paper, we propose a novel training strategy for unpaired image dehazing, termed Rehazy, to improve both dehazing performance and training stability. This strategy explores the consistency of the underlying clean images across hazy images and utilizes hazy-rehazy pairs for effective learning of real haze characteristics. To favorably construct hazy-rehazy pairs, we develop a physics-based rehazy generation pipeline, which is theoretically validated to reliably produce high-quality rehazy images. Additionally, leveraging the rehazy strategy, we introduce a dual-branch framework for dehazing network training, where a clean branch provides a basic dehazing capability in a synthetic manner, and a hazy branch enhances the generalization ability with hazy-rehazy pairs. Moreover, we design a new dehazing network within these branches to improve the efficiency, which progressively restores clean scenes from coarse to fine. Extensive experiments on four benchmarks demonstrate the superior performance of our approach, exceeding the previous state-of-the-art methods by 3.58 dB on the SOTS-Indoor dataset and by 1.85 dB on the SOTS-Outdoor dataset in PSNR. Our code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。