arXiv:2507.19184cs.CV2025-07被引 1

用持续学习统一处理雾霾、降雪、降雨图像修复,避免遗忘旧任务。

Continual Learning-Based Unified Model for Unpaired Image Restoration Tasks

  • 通过动态融合全局与局部特征提升适应性。
  • 在三个去雾、去雪、去雨任务上均超越当前最佳表现。
  • 适合自动驾驶等需多场景图像修复的实时应用。

由于天气条件差异大,针对雾霾、降雪、降雨等不同恶劣天气导致的图像退化问题修复极具挑战。现有方法多仅针对单一天气类型,而自动驾驶等应用需要统一模型处理多种退化。本文提出基于持续学习的统一图像修复框架,包含三项创新:(1) 可选择性核融合层,动态结合全局与局部特征实现鲁棒自适应特征选择;(2) 弹性权重固化(EWC)机制,支持跨多个修复任务的持续学习并缓解灾难性遗忘;(3) 一种新型循环对比损失,增强域转换中的特征区分性同时保持语义一致性。此外,提出无配对图像修复方法,降低对训练数据的依赖。在标准基准数据集上的大量实验表明,该方法在去雾、去雪、去雨任务中,于PSNR、SSIM及感知质量方面均显著优于现有最先进方法。

原文摘要 · Abstract (English)

Restoration of images contaminated by different adverse weather conditions such as fog, snow, and rain is a challenging task due to the varying nature of the weather conditions. Most of the existing methods focus on any one particular weather conditions. However, for applications such as autonomous driving, a unified model is necessary to perform restoration of corrupted images due to different weather conditions. We propose a continual learning approach to propose a unified framework for image restoration. The proposed framework integrates three key innovations: (1) Selective Kernel Fusion layers that dynamically combine global and local features for robust adaptive feature selection; (2) Elastic Weight Consolidation (EWC) to enable continual learning and mitigate catastrophic forgetting across multiple restoration tasks; and (3) a novel Cycle-Contrastive Loss that enhances feature discrimination while preserving semantic consistency during domain translation. Further, we propose an unpaired image restoration approach to reduce the dependance of the proposed approach on the training data. Extensive experiments on standard benchmark datasets for dehazing, desnowing and deraining tasks demonstrate significant improvements in PSNR, SSIM, and perceptual quality over the state-of-the-art.

图像修复持续学习无配对多任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。