arXiv:2503.17915eess.IVcs.AI2025-03被引 5

一个能自适应处理多种图像退化的高效统一修复框架。

Cat-AIR: Content and Task-Aware All-in-One Image Restoration

  • 根据内容和任务复杂度动态分配计算资源,平衡局部与全局信息。
  • 在多种修复任务上达到领先效果,且所需浮点运算更少。
  • 适合需要统一模型处理多类图像退化问题的研究与应用。

统一图像修复旨在不依赖退化来源先验知识的情况下,使用单一模型恢复各类退化的高质量图像。然而,现有方法在有效且高效处理多种退化类型时仍存在挑战。本文提出一种内容与任务感知的统一图像修复框架 Cat-AIR。该框架引入交替的空间-通道注意力机制,根据任务需求自适应平衡局部与全局信息。具体而言,通过跨层通道注意力与跨特征空间注意力,实现基于内容和任务复杂度的计算分配。此外,提出一种平滑学习策略,使模型能无缝适应新修复任务,同时保持对已有任务的性能。大量实验证明,Cat-AIR 在广泛修复任务中均达到当前最优结果,且所需浮点运算量(FLOPs)低于此前方法,为高效统一图像修复设立了新基准。

原文摘要 · Abstract (English)

All-in-one image restoration seeks to recover high-quality images from various types of degradation using a single model, without prior knowledge of the corruption source. However, existing methods often struggle to effectively and efficiently handle multiple degradation types. We present Cat-AIR, a novel \textbf{C}ontent \textbf{A}nd \textbf{T}ask-aware framework for \textbf{A}ll-in-one \textbf{I}mage \textbf{R}estoration. Cat-AIR incorporates an alternating spatial-channel attention mechanism that adaptively balances the local and global information for different tasks. Specifically, we introduce cross-layer channel attentions and cross-feature spatial attentions that allocate computations based on content and task complexity. Furthermore, we propose a smooth learning strategy that allows for seamless adaptation to new restoration tasks while maintaining performance on existing ones. Extensive experiments demonstrate that Cat-AIR achieves state-of-the-art results across a wide range of restoration tasks, requiring fewer FLOPs than previous methods, establishing new benchmarks for efficient all-in-one image restoration.

图像修复统一模型注意力机制高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。