arXiv:2606.17557cs.CV2026-06

用内化思维链让单模型搞定复杂图像修复

Universal Image Restoration via Internalized Chain-of-Thought Reasoning

论文配图:Universal Image Restoration via Internalized Chain-of-Thought Reasoning
图 1 · 摘自论文原文
  • 将修复任务视为图像编辑子问题,用预训练模型做起点
  • 通过可微分公式编码思维链,在单模型中实现多轮推理
  • 适合需要统一高效修复的科研与工业场景

图像修复旨在从退化输入中恢复高质量图像,但在复杂混合退化下变得高度病态。尽管统一模型常见,但其性能随退化复杂度上升而下降。近期方法采用思维链(CoT)推理,通过专用模块进行多轮修复,但面临两大局限:(i) 多步处理导致计算开销增加;(ii) 步进推理中退化间交互建模较弱。本文提出 CoTIR,一种将思维链推理内化的通用图像修复框架。我们视图像修复为图像编辑的特殊子任务,认为大规模预训练编辑模型提供更优优化起点。在此基础上,对模型进行微调,并通过受拉格朗日优化启发的可微分形式,将结构化思维链式推理编码至学习目标,实现无需串联专用修复器的全局修复。为支持训练与评估,我们构建了包含520万样本、带有思维链式推理轨迹的CoTIR-Bench基准。在CoTIR-Bench及广泛真实复合退化场景上的实验表明,CoTIR在感知质量上优于所有单一模型和多轮修复方法,保真度更具竞争力。代码已开源。

原文摘要 · Abstract (English)

Image restoration seeks to recover high-quality images from degraded inputs but becomes highly ill-posed under complex, mixed degradations. While unified all-in-one models are common, their performance declines as degradation complexity increases. Recent works adopt Chain-of-Thought (CoT) reasoning for multi-round restoration using specialized modules. However, this approach faces two key limitations: (i) increased computational cost due to multi-step processing, and (ii) weak modeling of interactions between degradations during stepwise inference. We introduce CoTIR, a universal image restoration framework that internalizes CoT reasoning within a single model. Concretely, we view image restoration as a specialized subtask of image editing, which implies that a large-scale pre-trained editing model provides a more favorable optimization starting point. Building on this, we fine-tune the model for restoration and further encode structured CoT-style reasoning into the learning objective via a differentiable formulation inspired by Lagrangian optimization, enabling holistic restoration without chaining specialized restorers. To facilitate training and evaluation, we further present CoTIR-Bench, a large-scale benchmark comprising 5.2 million samples with CoT-style reasoning traces. Extensive experiments on CoTIR-Bench and broad real composite degradation scenes show that CoTIR achieves stronger perceptual quality and more competitive fidelity than both all-in-one models and multi-round restoration methods. The source code is available at https://github.com/gy65896/CoTIR.

图像修复思维链预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。