用双脑机制自动优化图像修复,提升真实场景下的修复质量。
Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution

- 采用快思与慢思双系统,分别负责快速执行和深度规划。
- 在多个真实数据集上,显著优于现有方法的视觉效果和指标表现。
- 适合需要高质量图像修复的科研与工业应用。
现实世界图像修复(IR)因退化类型复杂且相互耦合而极具挑战。尽管近期基于大语言模型的智能体框架实现了灵活的工具规划,但仍存在两大瓶颈:一是搜索策略过度依赖贪心算法,难以平衡探索与利用;二是现有系统信息利用率低,存在记忆断层问题。为此,我们提出自进化智能体图像修复(SEAR),将修复过程建模为序列决策问题。受双过程理论启发,SEAR包含直觉执行器与深思规划器,分别遵循快速思考(系统1)与缓慢思考(系统2)原则。规划器采用剪枝感知蒙特卡洛树搜索实现长程推理,并结合无参考奖励与多模态大模型锦标赛机制,防止度量滥用。执行器则通过退化感知状态指纹构建自进化情景记忆,将昂贵的搜索轨迹提炼为可复用的适应性知识,克服记忆断层,逐步摊销冷启动探索成本。在合成与真实世界基准上的大量实验表明,该方法在感知质量和定量指标上均表现出色。
原文摘要 · Abstract (English)
Real-world image restoration (IR) remains challenging due to complex and coupled degradations. While recent agentic IR frameworks leverage Large Language Models for flexible tool planning, they face two critical limitations. First, from a search scheme perspective, excessive reliance on greedy strategies fails to balance exploration and exploitation. Second, existing agentic systems underutilize information, exhibiting episodic amnesia. To address these challenges, we propose \textbf{Self-Evolving Agentic Image Restoration (SEAR)}, which formulates restoration as a sequential decision-making problem. Inspired by the dual-process theory, SEAR comprises an Intuitive Executor and a Deliberate Planner, respectively following the fast-thinking \textit{System 1} and slow-thinking \textit{System 2} principles. The Deliberate Planner employs Pruning-Aware Monte Carlo Tree Search for long-horizon reasoning, utilizing a hybrid no-reference reward and a Multimodal Large Language Model (MLLM)-based tournament to prevent metric exploitation. Complementarily, the Intuitive Executor leverages a self-evolving episodic memory indexed by degradation-aware state fingerprints. This mechanism distills expensive search trajectories into adaptive expertise, overcoming episodic amnesia while progressively amortizing cold-start exploration costs through memory reuse. Extensive experiments on synthetic and real-world benchmarks demonstrate its strong perceptual and quantitative performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。