用通道分解与流形正则化,让图像修复模型高效通用。
Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization
- 按通道分工:分别处理局部纹理、全局上下文和通道统计。
- 跨层对比对齐,在正定空间提升特征一致性,泛化性更强。
- 兼顾速度与效果,适合未知退化场景的实用修复任务。
退化无关图像修复旨在用单一模型应对多种图像退化,但效率与性能难以兼顾。现有方法或牺牲效率以求通用,或无法捕捉不同退化的表征需求。本文提出MIRAGE框架,通过两项创新解决该问题。首先,提出通道级功能分解,将注意力机制中的通道冗余重新分配:卷积分支处理局部纹理,注意力分支建模全局上下文,MLP分支捕获通道统计特征。这一系统性设计实现退化无关学习,并在效率-性能间取得更优平衡。其次,引入流形正则化,在对称正定(SPD)空间中进行跨层对比对齐,实验证明可显著提升特征一致性和跨退化泛化能力。大量实验表明,MIRAGE在各类全合一修复设置下达到当前最优性能,兼具高效率与可扩展性,适用于挑战性的未见修复场景。
原文摘要 · Abstract (English)
Degradation-agnostic image restoration aims to handle diverse corruptions with one unified model, but faces fundamental challenges in balancing efficiency and performance across different degradation types. Existing approaches either sacrifice efficiency for versatility or fail to capture the distinct representational requirements of various degradations. We present MIRAGE, an efficient framework that addresses these challenges through two key innovations. First, we propose a channel-wise functional decomposition that systematically repurposes channel redundancy in attention mechanisms by assigning CNN, attention, and MLP branches to handle local textures, global context, and channel statistics, respectively. This principled decomposition enables degradation-agnostic learning while achieving superior efficiency-performance trade-offs. Second, we introduce manifold regularization that performs cross-layer contrastive alignment in Symmetric Positive Definite (SPD) space, which empirically improves feature consistency and generalization across degradation types. Extensive experiments demonstrate that MIRAGE achieves state-of-the-art performance with remarkable efficiency, outperforming existing methods in various all-in-one IR settings while offering a scalable and generalizable solution for challenging unseen IR scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。