arXiv:2508.08556cs.CV2025-08ICCV被引 2

提出双模式网络,让扩散先验更好还原真实人脸退化图像。

Unlocking the Potential of Diffusion Priors in Blind Face Restoration

  • 用双模式网络分别处理修复与退化建模,提升适应性。
  • 在基准数据集上,修复真实度和保真度均优于现有方法。
  • 能更真实模拟现实中的复杂退化,适合实际应用场景。

尽管扩散先验在盲人脸修复(BFR)中展现出强大潜力,但原始扩散模型与BFR场景之间存在固有差距,主要源于高质量(HQ)与低质量(LQ)图像之间的差异,以及合成图像与真实世界图像之间的不匹配。原始扩散模型训练于无退化或退化较少的图像,而BFR需处理中到严重退化的图像;且训练用的LQ图像由简单退化模型生成,退化模式有限,难以模拟真实世界中复杂未知的退化。为此,本文提出统一网络FLIPNET,具备两种模式:修复模式下逐步融合面向BFR的特征与人脸嵌入,实现真实可信的修复;退化模式下基于真实退化数据集学习的知识,生成类真实退化图像。在多个基准数据集上的评估表明,该模型在真实性与保真度上优于现有基于扩散先验的BFR方法,同时在建模真实退化方面也优于朴素退化模型。

原文摘要 · Abstract (English)

Although diffusion prior is rising as a powerful solution for blind face restoration (BFR), the inherent gap between the vanilla diffusion model and BFR settings hinders its seamless adaptation. The gap mainly stems from the discrepancy between 1) high-quality (HQ) and low-quality (LQ) images and 2) synthesized and real-world images. The vanilla diffusion model is trained on images with no or less degradations, whereas BFR handles moderately to severely degraded images. Additionally, LQ images used for training are synthesized by a naive degradation model with limited degradation patterns, which fails to simulate complex and unknown degradations in real-world scenarios. In this work, we use a unified network FLIPNET that switches between two modes to resolve specific gaps. In Restoration mode, the model gradually integrates BFR-oriented features and face embeddings from LQ images to achieve authentic and faithful face restoration. In Degradation mode, the model synthesizes real-world like degraded images based on the knowledge learned from real-world degradation datasets. Extensive evaluations on benchmark datasets show that our model 1) outperforms previous diffusion prior based BFR methods in terms of authenticity and fidelity, and 2) outperforms the naive degradation model in modeling the real-world degradations.

人脸修复扩散模型退化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。