arXiv:2503.18703cs.CV2025-03CVPR被引 23

无需成对数据,用自重构和通道一致性提升去雨效果

Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining

  • 引入通道一致性先验,生成逼真伪雨图
  • 自重构策略减少冗余信息,提升去雨质量
  • 在多个真实数据集上表现优异,泛化性强

近年来基于成对数据的深度去雨模型取得了显著进展,但因真实成对数据难获取且泛化能力差,难以应用于实际场景。本文提出一种基于通道一致性先验与自重构策略的无监督去雨框架CSUD,利用无配对数据训练时生成高质量伪干净与伪雨图像对,以增强去雨网络性能。为在转移雨条纹的同时保留更多背景细节,提出通道一致性损失(CCLoss),通过引入雨条纹的通道一致性先验,使生成的伪雨图更接近真实雨图。此外,设计自重构策略缓解生成器中的冗余信息传递问题,进一步提升去雨性能与泛化能力。在多个合成及真实世界数据集上的大量实验表明,CSUD优于现有先进无监督方法,且具备更强泛化能力。

原文摘要 · Abstract (English)

Recently, deep image deraining models based on paired datasets have made a series of remarkable progress. However, they cannot be well applied in real-world applications due to the difficulty of obtaining real paired datasets and the poor generalization performance. In this paper, we propose a novel Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining framework, CSUD, to tackle the aforementioned challenges. During training with unpaired data, CSUD is capable of generating high-quality pseudo clean and rainy image pairs which are used to enhance the performance of deraining network. Specifically, to preserve more image background details while transferring rain streaks from rainy images to the unpaired clean images, we propose a novel Channel Consistency Loss (CCLoss) by introducing the Channel Consistency Prior (CCP) of rain streaks into training process, thereby ensuring that the generated pseudo rainy images closely resemble the real ones. Furthermore, we propose a novel Self-Reconstruction (SR) strategy to alleviate the redundant information transfer problem of the generator, further improving the deraining performance and the generalization capability of our method. Extensive experiments on multiple synthetic and real-world datasets demonstrate that the deraining performance of CSUD surpasses other state-of-the-art unsupervised methods and CSUD exhibits superior generalization capability.

去雨无监督图像修复自重构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。