arXiv:2505.12630cs.CVcs.AI2025-05CVPR被引 62

通过感知退化类型的特征扰动,提升统一图像修复模型的泛化能力。

Degradation-Aware Feature Perturbation for All-in-One Image Restoration

  • 根据退化类型动态调整特征通道与注意力,缓解任务干扰。
  • 在去噪、去雾、去雨等五项任务上均达到领先性能。
  • 适合需要统一处理多种图像退化的实际应用开发者。

全功能图像修复旨在使用单一模型恢复多种退化类型和程度的清晰图像。然而,不同退化类型间显著差异给训练通用模型带来挑战,常导致任务干扰,即不同任务的梯度更新方向因共享参数而发散。受路由策略启发,本文提出DFPIR,引入退化感知特征扰动(DFP),调整特征空间以匹配统一参数空间。主要包含通道级扰动和注意力级扰动:通道级扰动通过按退化类型引导高维空间中的通道混洗实现;注意力级扰动则通过注意力空间的选择性掩码达成。为此,我们设计退化引导扰动模块(DGPB),置于编码-解码架构的编码与解码阶段之间。大量实验表明,DFPIR在图像去噪、去雾、去雨、运动模糊去除及低光增强等多项全功能图像修复任务中均取得当前最优表现。代码已开源:https://github.com/TxpHome/DFPIR。

原文摘要 · Abstract (English)

All-in-one image restoration aims to recover clear images from various degradation types and levels with a unified model. Nonetheless, the significant variations among degradation types present challenges for training a universal model, often resulting in task interference, where the gradient update directions of different tasks may diverge due to shared parameters. To address this issue, motivated by the routing strategy, we propose DFPIR, a novel all-in-one image restorer that introduces Degradation-aware Feature Perturbations(DFP) to adjust the feature space to align with the unified parameter space. In this paper, the feature perturbations primarily include channel-wise perturbations and attention-wise perturbations. Specifically, channel-wise perturbations are implemented by shuffling the channels in high-dimensional space guided by degradation types, while attention-wise perturbations are achieved through selective masking in the attention space. To achieve these goals, we propose a Degradation-Guided Perturbation Block (DGPB) to implement these two functions, positioned between the encoding and decoding stages of the encoder-decoder architecture. Extensive experimental results demonstrate that DFPIR achieves state-of-the-art performance on several all-in-one image restoration tasks including image denoising, image dehazing, image deraining, motion deblurring, and low-light image enhancement. Our codes are available at https://github.com/TxpHome/DFPIR.

图像修复多任务学习特征扰动统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。