arXiv:2503.09403cs.CVcs.AI2025-03IJCV被引 23

多智能体协作修复复杂图像退化,效果更优且推理更快。

Multi-Agent Image Restoration

  • 分三阶段逆序恢复真实世界退化:场景、成像、压缩
  • 多智能体分工协作,修复质量超越现有方法,效率提升明显
  • 支持新工具快速接入,适合实际图像修复场景

图像修复因现实世界退化的复杂性而极具挑战。尽管已有多种专用和一体化修复模型,但仍难以有效处理混合退化问题。近期的智能体方法如RestoreAgent和AgenticIR虽能缓解此问题,但受限于资源密集的微调、低效搜索与试错机制,导致结果不佳且效率低下。本文提出MAIR——一种面向复杂图像修复的新型多智能体方法。我们引入真实世界退化先验,将退化分为三类:(1) 场景退化,(2) 成像退化,(3) 压缩退化,并依据其在真实世界中出现的顺序反向恢复。基于此三阶段框架,MAIR模拟由调度员统筹规划、多个专家分别应对特定退化问题的协作团队。该设计显著缩小搜索空间,减少试错成本,提升图像质量并降低推理开销。此外,引入注册机制实现新工具的便捷集成。在合成与真实数据集上的实验表明,所提MAIR在性能与效率上均优于此前的智能体修复系统。代码与模型将公开。

原文摘要 · Abstract (English)

Image restoration (IR) is challenging due to the complexity of real-world degradations. While many specialized and all-in-one IR models have been developed, they fail to effectively handle complex, mixed degradations. Recent agentic methods RestoreAgent and AgenticIR leverage intelligent, autonomous workflows to alleviate this issue, yet they suffer from suboptimal results and inefficiency due to their resource-intensive finetunings, and ineffective searches and tool execution trials for satisfactory outputs. In this paper, we propose MAIR, a novel Multi-Agent approach for complex IR problems. We introduce a real-world degradation prior, categorizing degradations into three types: (1) scene, (2) imaging, and (3) compression, which are observed to occur sequentially in real world, and reverse them in the opposite order. Built upon this three-stage restoration framework, MAIR emulates a team of collaborative human specialists, including a "scheduler" for overall planning and multiple "experts" dedicated to specific degradations. This design minimizes search space and trial efforts, improving image quality while reducing inference costs. In addition, a registry mechanism is introduced to enable easy integration of new tools. Experiments on both synthetic and real-world datasets show that proposed MAIR achieves competitive performance and improved efficiency over the previous agentic IR system. Code and models will be made available.

图像修复多智能体退化建模高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。