arXiv:2505.24207cs.CV2025-05被引 4

让图像修复模型在推理时自我纠错,提升修复质量

Boosting All-in-One Image Restoration via Self-Improved Privilege Learning

  • 用模型自身初结果生成伪特权信号,实现测试时迭代优化
  • 集成后在复合退化任务上提升4.58 dB,五任务基准提升1.28 dB
  • 轻量模块可嵌入多种架构,适合追求高精度修复的开发者

针对统一图像修复模型在多样混合退化下优化不稳定、任务间冲突的问题,本文提出自提升特权学习(SIPL)。该方法将特权信息(PI)的利用从训练阶段扩展至推理阶段,使模型能以自身初步输出作为伪特权信号,实现测试时的迭代自修正。核心是代理融合模块,包含可学习的特权字典,在训练中提取高频与结构先验;推理时则用该字典与初始恢复特征交互,形成自校正循环。SIPL可无缝融入多种主干网络,带来显著性能提升且计算开销极低。实验表明,结合PromptIR模型后,复合退化任务上PSNR提升+4.58 dB,五任务基准提升+1.28 dB,显著超越当前最优水平。

原文摘要 · Abstract (English)

Unified image restoration models for diverse and mixed degradations often suffer from unstable optimization dynamics and inter-task conflicts. This paper introduces Self-Improved Privilege Learning (SIPL), a novel paradigm that overcomes these limitations by innovatively extending the utility of privileged information (PI) beyond training into the inference stage. Unlike conventional Privilege Learning, where ground-truth-derived guidance is typically discarded after training, SIPL empowers the model to leverage its own preliminary outputs as pseudo-privileged signals for iterative self-refinement at test time. Central to SIPL is Proxy Fusion, a lightweight module incorporating a learnable Privileged Dictionary. During training, this dictionary distills essential high-frequency and structural priors from privileged feature representations. Critically, at inference, the same learned dictionary then interacts with features derived from the model's initial restoration, facilitating a self-correction loop. SIPL can be seamlessly integrated into various backbone architectures, offering substantial performance improvements with minimal computational overhead. Extensive experiments demonstrate that SIPL significantly advances the state-of-the-art on diverse all-in-one image restoration benchmarks. For instance, when integrated with the PromptIR model, SIPL achieves remarkable PSNR improvements of +4.58 dB on composite degradation tasks and +1.28 dB on diverse five-task benchmarks, underscoring its effectiveness and broad applicability. Codes are available at our project page https://github.com/Aitical/SIPL.

图像修复自修正轻量设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。