arXiv:2504.14249cs.CV2025-04中稿 · TMLR in 2026被引 5

一个模型搞定多种图像退化修复,又快又省资源。

Any Image Restoration via Efficient Spatial-Frequency Degradation Adaptation

  • 用统一嵌入机制捕捉不同退化的共性特征
  • 在四个综合基准上达最优,参数减少84%,计算量降80%
  • 无需大模型或额外模块,适合移动端部署

通过单一模型高效修复多种图像退化问题日益重要,尤其在移动设备普及的背景下。传统方法需为每类退化训练专用模型,效率低下且冗余。近期方法或引入视觉提示模块增大模型规模,或依赖大规模语言模型进行跨模态迁移,增加系统复杂性。本文提出AnyIR,采用统一路径,利用各类退化间的内在相似性,通过联合嵌入机制实现高效全面的修复,不增加模型规模,也无需依赖大语言模型。具体而言,先分析输入的子潜空间,识别关键成分并以门控方式重加权;为融合内在退化感知与上下文注意力,提出空间-频率并行融合策略,增强空间感知的全局交互,从频域提升修复保真度。在四个全一体化修复基准上的综合评估表明,AnyIR达到当前最优性能,相比基线模型参数减少84%,浮点运算量降低80%。结果表明AnyIR是未来一体化图像修复的有效轻量化解决方案。代码已开源:https://github.com/Amazingren/AnyIR。

原文摘要 · Abstract (English)

Restoring multiple degradations efficiently via just one model has become increasingly significant and impactful, especially with the proliferation of mobile devices. Traditional solutions typically involve training dedicated models per degradation, resulting in inefficiency and redundancy. More recent approaches either introduce additional modules to learn visual prompts, significantly increasing the size of the model, or incorporate cross modal transfer from large language models trained on vast datasets, adding complexity to the system architecture. In contrast, our approach, termed AnyIR, takes a unified path that leverages inherent similarity across various degradations to enable both efficient and comprehensive restoration through a joint embedding mechanism, without scaling up the model or relying on large language models. Specifically, we examine the sublatent space of each input, identifying key components and reweighting them first in a gated manner. To unify intrinsic degradation awareness with contextualized attention, we propose a spatial frequency parallel fusion strategy that strengthens spatially informed local global interactions and enriches restoration fidelity from the frequency domain. Comprehensive evaluations across four all-in-one restoration benchmarks demonstrate that AnyIR attains SOTA performance while reducing model parameters by 84% and FLOPs by 80% relative to the baseline. These results highlight the potential of AnyIR as an effective and lightweight solution for further all in one image restoration. Our code is available at: https://github.com/Amazingren/AnyIR.

图像修复轻量化统一模型频域处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。