arXiv:2601.20306cs.CV2026-01被引 2

用三类先验分层引导扩散模型,提升图像修复的细节和鲁棒性。

TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restoration

  • 分层设计:浅层用结构先验、深层用语义先验、全程用退化先验。
  • 在多种退化场景下均超越现有方法,尤其在严重模糊区域表现更优。
  • 适合需要统一处理多种图像退化的实际应用,如老旧照片修复。

全功能图像修复旨在使用单一统一模型处理多种退化类型。现有方法通常依赖退化先验进行修复,但在严重退化区域难以重建内容。尽管近期工作引入语义信息辅助生成,但将其融入扩散模型浅层常破坏空间结构(如产生模糊伪影)。为此,我们提出三先验引导扩散网络(TPGDiff)用于统一图像修复。TPGDiff在扩散轨迹中持续引入退化先验,同时将结构先验注入浅层、语义先验注入深层,实现分层互补的先验引导。具体而言,利用多源结构线索作为结构先验,捕捉细粒度细节并指导浅层表征;进一步设计基于知识蒸馏的语义提取器,生成鲁棒语义先验,确保在严重退化下深层仍具可靠高层引导;此外,采用退化提取器学习退化感知先验,实现各时间步的阶段自适应控制。在单退化与多退化基准上的大量实验表明,TPGDiff在多样修复场景中均取得优越性能与泛化能力。

原文摘要 · Abstract (English)

All-in-one image restoration aims to address diverse degradation types using a single unified model. Existing methods typically rely on degradation priors to guide restoration, yet often struggle to reconstruct content in severely degraded regions. Although recent works leverage semantic information to facilitate content generation, integrating it into the shallow layers of diffusion models often disrupts spatial structures (\emph{e.g.}, blurring artifacts). To address this issue, we propose a Triple-Prior Guided Diffusion (TPGDiff) network for unified image restoration. TPGDiff incorporates degradation priors throughout the diffusion trajectory, while introducing structural priors into shallow layers and semantic priors into deep layers, enabling hierarchical and complementary prior guidance for image reconstruction. Specifically, we leverage multi-source structural cues as structural priors to capture fine-grained details and guide shallow layers representations. To complement this design, we further develop a distillation-driven semantic extractor that yields robust semantic priors, ensuring reliable high-level guidance at deep layers even under severe degradations. Furthermore, a degradation extractor is employed to learn degradation-aware priors, enabling stage-adaptive control of the diffusion process across all timesteps. Extensive experiments on both single- and multi-degradation benchmarks demonstrate that TPGDiff achieves superior performance and generalization across diverse restoration scenarios. Our project page is: https://leoyjtu.github.io/tpgdiff-project.

图像修复扩散模型先验引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。