arXiv:2511.21043cs.CV2025-11

用物理约束引导生成模型,让模糊图像恢复更真实且不失细节。

PG-ControlNet: A Physics-Guided ControlNet for Generative Spatially Varying Image Deblurring

  • 用高维压缩核建模复杂模糊变化,精细刻画退化场。
  • 结合控制网络与扩散模型,在严重模糊下保持细节真实性。
  • 适合需要高保真去模糊的图像修复、医学成像等场景。

空间变化模糊恢复仍是根本性难题,尤其在运动模糊与其他模糊混合且噪声显著时。现有学习方法分为两类:基于模型的深度展开方法虽有物理约束但易过平滑、产生伪影;生成模型感知质量优却因物理约束弱而幻觉细节。本文提出新框架,将强大生成先验与显式密集物理约束相结合。不简化退化场,而是建模为高维压缩核的稠密连续体,捕捉细微运动与退化模式变化。利用该丰富描述场条件化ControlNet,强力引导扩散采样过程。大量实验表明,本方法有效弥合物理准确与感知真实之间的差距,在严重模糊场景中优于现有模型基方法与生成基基线。

原文摘要 · Abstract (English)

Spatially varying image deblurring remains a fundamentally ill-posed problem, especially when degradations arise from complex mixtures of motion and other forms of blur under significant noise. State-of-the-art learning-based approaches generally fall into two paradigms: model-based deep unrolling methods that enforce physical constraints by modeling the degradations, but often produce over-smoothed, artifact-laden textures, and generative models that achieve superior perceptual quality yet hallucinate details due to weak physical constraints. In this paper, we propose a novel framework that uniquely reconciles these paradigms by taming a powerful generative prior with explicit, dense physical constraints. Rather than oversimplifying the degradation field, we model it as a dense continuum of high-dimensional compressed kernels, ensuring that minute variations in motion and other degradation patterns are captured. We leverage this rich descriptor field to condition a ControlNet architecture, strongly guiding the diffusion sampling process. Extensive experiments demonstrate that our method effectively bridges the gap between physical accuracy and perceptual realism, outperforming state-of-the-art model-based methods as well as generative baselines in challenging, severely blurred scenarios.

图像去模糊控制网络生成模型物理引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。