无需配对数据,统一恢复多种天气下的图像质量。
WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learning
- 通过亮度-色度解耦实现退化与内容分离,避免复杂天气建模。
- 在多个真实天气数据集上达到当前最优无监督性能,泛化能力强。
- 适合处理复杂天气退化场景的图像修复任务,尤其适用于自动驾驶感知系统。
无监督多天气图像恢复仍是基础但未充分探索的挑战。现有方法依赖特定物理先验,限制了其在多样化真实天气场景中的可扩展性与泛化能力。本文提出 extbf{WeatherCycle},一个统一的无配对框架,将天气恢复重构为双向退化-内容转换循环,并通过退化感知课程正则化引导。核心采用 extit{lumina-chroma decomposition} 策略,解耦退化与内容,无需建模复杂天气。为建模多样复杂的退化,提出 extit{Lumina Degradation Guidance Module}(LDGM),从退化图像池中学习亮度退化先验,并通过频域幅度调制注入干净图像,实现可控且真实的退化建模。此外,引入 extit{Difficulty-Aware Contrastive Regularization}(DACR)模块,基于 CLIP 分类器识别难样本,并强制难样本与重建特征间的对比对齐,提升语义一致性与鲁棒性。在多个多天气数据集上的大量实验表明,该方法在无监督场景下达到最先进性能,对复杂天气退化具有强泛化能力。
原文摘要 · Abstract (English)
Unsupervised image restoration under multi-weather conditions remains a fundamental yet underexplored challenge. While existing methods often rely on task-specific physical priors, their narrow focus limits scalability and generalization to diverse real-world weather scenarios. In this work, we propose \textbf{WeatherCycle}, a unified unpaired framework that reformulates weather restoration as a bidirectional degradation-content translation cycle, guided by degradation-aware curriculum regularization. At its core, WeatherCycle employs a \textit{lumina-chroma decomposition} strategy to decouple degradation from content without modeling complex weather, enabling domain conversion between degraded and clean images. To model diverse and complex degradations, we propose a \textit{Lumina Degradation Guidance Module} (LDGM), which learns luminance degradation priors from a degraded image pool and injects them into clean images via frequency-domain amplitude modulation, enabling controllable and realistic degradation modeling. Additionally, we incorporate a \textit{Difficulty-Aware Contrastive Regularization (DACR)} module that identifies hard samples via a CLIP-based classifier and enforces contrastive alignment between hard samples and restored features to enhance semantic consistency and robustness. Extensive experiments across serve multi-weather datasets, demonstrate that our method achieves state-of-the-art performance among unsupervised approaches, with strong generalization to complex weather degradations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。