arXiv:2601.19506cs.CV2026-01TPAMI被引 3

提出分层框架,让模糊人脸修复更准更稳,避免修出错脸。

Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration

  • 用语义+文本生成结构锚点,稳定修复方向
  • 在锚点约束下恢复细节,身份一致性提升明显
  • 适合需要高保真、低不确定性的实际人脸修复场景

盲人脸修复因输入严重退化而本质病态,现有生成方法虽能合成逼真细节,但易产生身份不一致结果。本文提出Pref-Restore,一种分层确定性盲修复框架。设计包含三个互补原则:(1) 语义信息增强,通过自回归语义分支将图像和文本线索转化为结构化令牌,提供稳定的高层锚点;(2) 纹理级保真对齐,扩散生成器在该锚点约束下恢复身份相关细节;(3) 保真度约束偏好优化,利用人脸感知奖励控制扩散轨迹,平衡质量与保真度。在合成与真实世界基准上的大量实验表明,Pref-Restore实现最先进性能,具备更强的身份敏感保真度与更低的重复采样不确定性。系统性消融分析验证了分阶段训练的必要性、文本路径在部署条件下的鲁棒性,以及保真度约束优化的优势。

原文摘要 · Abstract (English)

Blind face restoration remains a persistent challenge due to the inherent ill-posedness of reconstructing holistic structures from severely constrained observations. Current generative paradigms, while capable of synthesizing realistic facial details, remain limited by the under-constrained nature of blind restoration, where severely degraded inputs can be mapped to plausible yet identity-inconsistent outputs. To address this issue, we present Pref-Restore, a hierarchical framework for deterministic BFR. Our design is organized around three complementary principles: (1) Semantic Information Augmentation, where an auto-regressive semantic branch converts image and text cues into structured tokens that provide a stable high-level anchor; (2) Texture-level Fidelity Alignment, where the diffusion generator is trained under this anchor to recover identity-relevant details; and (3) Fidelity-constrained Preference Optimization, where a face-aware reward refines the diffusion trajectory while controlling the quality-fidelity trade-off. Extensive experiments on synthetic and real-world benchmarks show that Pref-Restore achieves state-of-the-art performance, with stronger identity-sensitive fidelity and lower restoration uncertainty across repeated sampling. Systematic ablations further attribute these gains to the proposed hierarchical design, showing the necessity of staged training, the robustness of the text pathway under deployment-faithful conditions, and the benefit of fidelity-constrained preference optimization.

人脸修复扩散模型分层架构身份一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。