arXiv:2603.29773cs.CV2026-03中稿 · CVPR被引 4

用图像质量先验提升真实世界图像修复的感知效果

Beyond Ground-Truth: Leveraging Image Quality Priors for Real-World Image Restoration

  • 引入无参考图像质量评估模型提取质量先验,指导修复过程
  • 在真实数据集上优于当前最优方法,显著提升感知质量
  • 适合需要高质量输出的图像修复任务,兼容现有架构

真实世界图像修复旨在从非受控条件下拍摄的低质量输入中恢复高质量图像。现有方法通常依赖于真实值(GT)监督,假设其提供完美参考质量,但真实值本身可能存在感知一致性差异,导致模型收敛于训练数据的平均质量水平,而非可达到的最高感知质量。为此,我们提出一种新框架IQPIR,引入从预训练无参考图像质量评估(NR-IQA)模型中提取的图像质量先验(IQP),显式引导修复过程向感知最优输出靠拢。该方法通过三个关键机制实现:(1)质量条件化Transformer,利用NR-IQA得分作为条件信号,引导预测表示向最大感知质量方向演进,且无需结构修改即可与现有修复架构无缝集成;(2)双分支码本结构,分离通用特征与高质量特异性特征,全面表征结构信息与质量敏感属性;(3)基于离散表示的质量优化策略,缓解连续潜在空间中常见的过优化问题。在真实世界图像修复任务上的大量实验表明,该方法不仅超越现有先进方法,还可作为通用的质量引导增强策略适配已有模型。代码已开源。

原文摘要 · Abstract (English)

Real-world image restoration aims to restore high-quality (HQ) images from degraded low-quality (LQ) inputs captured under uncontrolled conditions. Existing methods typically depend on ground-truth (GT) supervision, assuming that GT provides perfect reference quality. However, GT can still contain images with inconsistent perceptual fidelity, causing models to converge to the average quality level of the training data rather than achieving the highest perceptual quality attainable. To address these problems, we propose a novel framework, termed IQPIR, that introduces an Image Quality Prior (IQP)-extracted from pre-trained No-Reference Image Quality Assessment (NR-IQA) models-to guide the restoration process toward perceptually optimal outputs explicitly. Our approach synergistically integrates IQP with a learned codebook prior through three key mechanisms: (1) a quality-conditioned Transformer, where NR-IQA-derived scores serve as conditioning signals to steer the predicted representation toward maximal perceptual quality. This design provides a plug-and-play enhancement compatible with existing restoration architectures without structural modification; and (2) a dual-branch codebook structure, which disentangles common and HQ-specific features, ensuring a comprehensive representation of both generic structural information and quality-sensitive attributes; and (3) a discrete representation-based quality optimization strategy, which mitigates over-optimization effects commonly observed in continuous latent spaces. Extensive experiments on real-world image restoration demonstrate that our method not only surpasses cutting-edge methods but also serves as a generalizable quality-guided enhancement strategy for existing methods. The code is available.

图像修复质量先验NR-IQA感知优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。