动态调整去模糊过程,让人脸修复更准更清晰。
DynFaceRestore: Balancing Fidelity and Quality in Diffusion-Guided Blind Face Restoration with Dynamic Blur-Level Mapping and Guidance
- 根据输入模糊程度动态选择扩散起始步数
- 局部调节引导强度,提升细节保留与结构准确
- 在真实模糊场景下表现优异,适合复杂修复任务
盲人脸修复旨在从未知退化输入中恢复高保真、细节丰富的面部图像,面临身份与细节双重保持的挑战。预训练扩散模型常被用作图像先验以生成精细细节,但现有方法多采用固定扩散采样步数和全局引导尺度,假设退化均匀,导致退化核估计不准确时易出现欠扩散或过扩散,破坏保真度与质量平衡。本文提出DynFaceRestore,通过学习将任意盲退化输入映射为高斯模糊图像,并利用对应的高斯核动态选择每张模糊图的扩散起始步数,同时在扩散过程中采用闭式引导维持保真度。此外,引入动态引导缩放调节器,按局部区域调节引导强度,在复杂区域增强细节生成,同时保持轮廓结构准确。该策略有效平衡了保真度与质量之间的权衡。在定量与定性评估中均达到当前最优性能,展现出对盲人脸修复的强鲁棒性与有效性。
原文摘要 · Abstract (English)
Blind Face Restoration aims to recover high-fidelity, detail-rich facial images from unknown degraded inputs, presenting significant challenges in preserving both identity and detail. Pre-trained diffusion models have been increasingly used as image priors to generate fine details. Still, existing methods often use fixed diffusion sampling timesteps and a global guidance scale, assuming uniform degradation. This limitation and potentially imperfect degradation kernel estimation frequently lead to under- or over-diffusion, resulting in an imbalance between fidelity and quality. We propose DynFaceRestore, a novel blind face restoration approach that learns to map any blindly degraded input to Gaussian blurry images. By leveraging these blurry images and their respective Gaussian kernels, we dynamically select the starting timesteps for each blurry image and apply closed-form guidance during the diffusion sampling process to maintain fidelity. Additionally, we introduce a dynamic guidance scaling adjuster that modulates the guidance strength across local regions, enhancing detail generation in complex areas while preserving structural fidelity in contours. This strategy effectively balances the trade-off between fidelity and quality. DynFaceRestore achieves state-of-the-art performance in both quantitative and qualitative evaluations, demonstrating robustness and effectiveness in blind face restoration. Project page at https://nycu-acm.github.io/DynFaceRestore/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。