arXiv:2511.18152cs.CVcs.AI2025-11

用扩散模型提升盲图像修复,让结果更清晰有细节。

UnfoldLDM: Degradation-Aware Unfolding with Iterative Latent Diffusion Priors for Blind Image Restoration

  • 分阶段优化:先估计模糊类型,再用扩散模型提取鲁棒先验。
  • 修复后图像纹理更丰富,比现有方法在多个任务上表现更好。
  • 适合做图像修复、增强等下游任务,可直接接入现有网络框架。

深度展开网络(DUNs)结合了模型驱动方法的可解释性与深度学习的泛化能力,但在盲图像修复(BIR)任务中仍受限于两点:一是退化模型依赖性强,仅适用于已知退化类型;二是梯度下降输出以低频内容为主,直接输入近端项导致过平滑,丢失细纹理。为此,本文提出UnfoldLDM,将DUNs与潜在扩散模型(LDM)结合用于BIR。每阶段采用多粒度退化感知模块(MGDA)作为梯度下降步,将BIR建模为未知退化估计问题,同时估计整体退化矩阵及其分解形式,实现对复杂退化的鲁棒建模。近端步骤设计退化抵抗扩散模型(DR-LDM),从MGDA输出中提取紧凑的退化不变先验。基于该先验,过平滑修正变换器(OCFormer)显式恢复高频成分,增强纹理细节。这种组合确保最终结果既无退化残留又视觉丰富。实验表明,UnfoldLDM在多种BIR任务中达到领先性能,并显著提升下游任务效果。此外,其设计兼容现有DUN方法,可作为即插即用模块使用。代码将公开。

原文摘要 · Abstract (English)

Deep unfolding networks (DUNs) combine the interpretability of model-based methods with the learning ability of deep networks, yet remain limited for blind image restoration (BIR). Existing DUNs suffer from: (1) \textbf{Degradation-specific dependency}, as their optimization frameworks are tied to a known degradation model, making them unsuitable for BIR tasks; and (2) \textbf{Over-smoothing bias}, resulting from the direct feeding of gradient descent outputs, dominated by low-frequency content, into the proximal term, suppressing fine textures. To overcome these issues, we propose UnfoldLDM to integrate DUNs with latent diffusion model (LDM) for BIR. In each stage, UnfoldLDM employs a multi-granularity degradation-aware (MGDA) module as the gradient descent step. MGDA models BIR as an unknown degradation estimation problem and estimates both the holistic degradation matrix and its decomposed forms, enabling robust degradation removal. For the proximal step, we design a degradation-resistant LDM (DR-LDM) to extract compact degradation-invariant priors from the MGDA output. Guided by this prior, an over-smoothing correction transformer (OCFormer) explicitly recovers high-frequency components and enhances texture details. This unique combination ensures the final result is degradation-free and visually rich. Experiments show that our UnfoldLDM achieves a leading place on various BIR tasks and benefits downstream tasks. Moreover, our design is compatible with existing DUN-based methods, serving as a plug-and-play framework. Code will be released.

图像修复扩散模型去模糊深度展开

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。