arXiv:2605.22104cs.CV2026-05

端到端优化图像修复规划与执行,提升复杂退化场景下的修复效果。

OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization

论文配图:OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization
图 1 · 摘自论文原文
  • 用强化学习直接优化工具组合策略,奖励为最终修复质量。
  • 通过代理引导的联合训练,让修复工具学会协同工作。
  • 在真实数据集上优于现有模型,尤其适合复杂退化场景。

真实世界图像修复因复杂的多重退化交互而极具挑战。现有基于智能体的方法通过组合多个专用修复工具来应对,但实证分析表明其性能受限于隐式约束的规划空间以及独立预训练工具间的缺乏协调。为此,我们提出OPERA(Optimized Planning-Execution Restoration Agent),一个端到端联合优化修复规划与工具执行的框架。在规划方面,OPERA利用强化学习在组合型规划空间中直接优化工具序列,以最终修复质量作为奖励信号;在执行方面,引入代理引导的联合训练机制,使修复工具在序列化组合中学会协作行为。在多退化基准和真实数据集上的大量实验表明,OPERA在多样化且复杂的退化场景下,持续优于全模型一体化修复方法及现有智能体方法。

原文摘要 · Abstract (English)

Real-world image restoration is challenging due to complex and interacting mixed degradations. Recent agent-based approaches address this problem by composing multiple task-specific restoration tools. However, empirical analysis reveals that their performance is fundamentally limited by implicitly constrained planning spaces and the lack of coordination among independently pretrained tools. To address these issues, we propose OPERA (Optimized Planning-Execution Restoration Agent), a framework that jointly optimizes restoration planning and tool execution in an end-to-end manner. On the planning side, OPERA uses reinforcement learning to directly optimize tool composition over a combinatorial plan space, with the final restoration quality as the reward. On the execution side, OPERA introduces agent-guided co-training of restoration tools, enabling them to learn cooperative behaviors under sequential composition. Extensive experiments on multi-degradation benchmarks and real-world datasets demonstrate that OPERA consistently outperforms both all-in-one restoration models and existing agent-based methods across diverse and complex degradation scenarios.

图像修复智能体端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。