arXiv:2505.22284cs.CV2025-05被引 2

提出统一域适应框架,让图像修复模型更好应对真实世界复杂退化。

From Controlled Scenarios to Real-World: Cross-Domain Degradation Pattern Matching for All-in-One Image Restoration

  • 用离散嵌入编码退化模式,通过对比学习增强识别能力。
  • 在10个数据集上达新最好效果,真实场景泛化性能显著提升。
  • 适合需要跨域通用修复的工业级图像处理场景。

作为基础成像任务,全功能图像修复(AiOIR)旨在通过单一模型和统一参数恢复多种退化模式。尽管现有方法在封闭控制场景中表现良好,但在真实世界场景中性能明显下降,主要因训练数据(源域)与真实测试数据(目标域)分布差异导致退化感知能力不足。为此,本文提出统一域适应图像修复(UDAIR)框架,利用源域知识有效迁移到目标域。为提升退化识别,设计了代码本以学习一组离散嵌入表示退化类型,并引入跨样本对比学习机制,捕捉特定退化下不同样本的共享特征。为弥合数据差距,提出域适应策略,通过动态对齐源域与目标域的代码本嵌入构建特征映射;同时设计基于相关性对齐的测试时自适应机制,通过将退化嵌入紧缩至源域聚类中心来校正对齐偏差。10个开源数据集上的实验表明,UDAIR在AiOIR任务上达到新最优性能。更重要的是,特征聚类验证了未知条件下退化识别的有效性,定性对比展示了对真实世界场景的强泛化能力。

原文摘要 · Abstract (English)

As a fundamental imaging task, All-in-One Image Restoration (AiOIR) aims to achieve image restoration caused by multiple degradation patterns via a single model with unified parameters. Although existing AiOIR approaches obtain promising performance in closed and controlled scenarios, they still suffered from considerable performance reduction in real-world scenarios since the gap of data distributions between the training samples (source domain) and real-world test samples (target domain) can lead inferior degradation awareness ability. To address this issue, a Unified Domain-Adaptive Image Restoration (UDAIR) framework is proposed to effectively achieve AiOIR by leveraging the learned knowledge from source domain to target domain. To improve the degradation identification, a codebook is designed to learn a group of discrete embeddings to denote the degradation patterns, and the cross-sample contrastive learning mechanism is further proposed to capture shared features from different samples of certain degradation. To bridge the data gap, a domain adaptation strategy is proposed to build the feature projection between the source and target domains by dynamically aligning their codebook embeddings, and a correlation alignment-based test-time adaptation mechanism is designed to fine-tune the alignment discrepancies by tightening the degradation embeddings to the corresponding cluster center in the source domain. Experimental results on 10 open-source datasets demonstrate that UDAIR achieves new state-of-the-art performance for the AiOIR task. Most importantly, the feature cluster validate the degradation identification under unknown conditions, and qualitative comparisons showcase robust generalization to real-world scenarios.

图像修复域适应退化识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。