arXiv:2602.23169cs.CV2026-02TPAMI被引 11

通过构建不变特征空间,实现跨退化类型的通用图像修复。

Learning Continuous Wasserstein Barycenter Space for Generalized All-in-One Image Restoration

  • 在沃尔德斯特距离中位空间对齐多源退化特征,学习共享不变表示。
  • 分离出退化无关与退化特定特征空间,提升泛化能力。
  • 适合处理未知退化类型和真实场景混合退化的图像修复任务。

尽管统一模型在应对多种图像退化方面取得显著进展,现有方法仍易受分布外退化影响,限制其在真实场景中的泛化性能。本文受启发于多源退化特征分布源自同一退化无关基础分布的假设,提出BaryIR框架,通过最小化到多个退化分布的平均沃尔德斯特距离,将多源退化特征对齐至沃氏中位(WB)空间,以建模退化无关分布。进一步引入残差子空间,其嵌入相互对比且正交于WB嵌入,从而显式解耦两个正交空间:一个编码跨退化共享的不变内容(WB空间),另一个自适应保留退化特异性知识。该解耦有效缓解了对分布内退化的过拟合,并支持基于退化无关共享不变性的自适应修复。大量实验表明,BaryIR在性能上媲美顶尖全一体方法;尤其在未见过的退化类型与程度下表现良好,即使训练数据退化类型有限,也能在混合真实退化数据上展现出卓越的泛化与鲁棒性。

原文摘要 · Abstract (English)

Despite substantial advances in all-in-one image restoration for addressing diverse degradations within a unified model, existing methods remain vulnerable to out-of-distribution degradations, thereby limiting their generalization in real-world scenarios. To tackle the challenge, this work is motivated by the intuition that multisource degraded feature distributions are induced by different degradation-specific shifts from an underlying degradation-agnostic distribution, and recovering such a shared distribution is thus crucial for achieving generalization across degradations. With this insight, we propose BaryIR, a representation learning framework that aligns multisource degraded features in the Wasserstein barycenter (WB) space, which models a degradation-agnostic distribution by minimizing the average of Wasserstein distances to multisource degraded distributions. We further introduce residual subspaces, whose embeddings are mutually contrasted while remaining orthogonal to the WB embeddings. Consequently, BaryIR explicitly decouples two orthogonal spaces: a WB space that encodes the degradation-agnostic invariant contents shared across degradations, and residual subspaces that adaptively preserve the degradation-specific knowledge. This disentanglement mitigates overfitting to in-distribution degradations and enables adaptive restoration grounded on the degradation-agnostic shared invariance. Extensive experiments demonstrate that BaryIR performs competitively against state-of-the-art all-in-one methods. Notably, BaryIR generalizes well to unseen degradations (\textit{e.g.,} types and levels) and shows remarkable robustness in learning generalized features, even when trained on limited degradation types and evaluated on real-world data with mixed degradations.

图像修复不变表示泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。