arXiv:2607.21125cs.CV2026-07

让图像修复智能体像人一样积累、修正经验,自动进化。

Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents

论文配图:Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
图 1 · 摘自论文原文
  • 用因果记忆图结构组织修复经验,支持多跳推理
  • 能根据修复效果自动更新或丢弃知识,长期更可靠
  • 适合需要持续学习的复杂图像修复场景

图像修复智能体作为应对真实世界中多样且不可预测退化的新范式,通常将修复视为工具使用过程:感知退化、搜索候选工具、执行操作并通过反思或回滚调整计划。然而,现有方法的知识存储为静态工具描述、手动定义的退化先验或无结构的文本摘要,限制了修复知识在长期经验中的积累、验证、修订与遗忘。本文提出 Causal-AgentIR,一个具有自演化因果记忆的分层多智能体框架,用于集体图像修复智能。该框架不将修复经验视为孤立文本记录,而是将退化模式、图像区域、修复工具、操作、质量变化和用户偏好组织成结构化的因果记忆图。该图支持基于图的检索和多跳因果推理,使智能体能够推断特定修复操作或工具序列在不同退化条件下的质量影响。框架还将多个智能体组织为协作系统,包括规划、退化分析、工具专长、因果记忆推理、结果评价和记忆维护。通过此设计,修复经验可根据观测到的质量变化和反馈进行添加、更新、合并、强化、忽略或丢弃,使智能体能保持可靠且可迁移的修复知识。大量实验验证了该框架的有效性。

原文摘要 · Abstract (English)

Image restoration agents have recently emerged as a flexible paradigm for handling diverse and unpredictable degradations in real-world scenarios. Existing agents typically formulate restoration as a tool-using process, where the agent perceives degradations, searches candidate tools, executes restoration operations, and revises the plan through reflection or rollback. However, their knowledge is often stored as static tool descriptions, manually defined degradation priors, or unstructured textual summaries, which limits the accumulation, verification, revision, and forgetting of restoration knowledge over long-term experience. In this paper, we propose Causal-AgentIR, a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence. Instead of representing restoration experience as isolated textual records, Causal-AgentIR organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph. This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions. The framework further organizes multiple agents into a collaborative system, including planning, degradation analysis, tool expertise, causal memory reasoning, outcome critique, and memory curation. Through this design, restoration experience can be added, updated, merged, reinforced, ignored, or discarded according to observed quality changes and feedback, allowing the agent to maintain reliable and transferable restoration knowledge. Extensive experiments demonstrate the effectiveness of the proposed framework.

图像修复多智能体因果推理自演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。