arXiv:2510.04410cs.CV2025-10

提升人脸修复质量与身份一致性,解决生成与保真之间的矛盾。

CodeFormer++: Blind Face Restoration Using Deformable Registration and Deep Metric Learning

  • 通过可变形对齐实现生成与修复人脸的语义对齐。
  • 动态提取生成脸纹理以增强保真的修复效果。
  • 结合深度度量学习,更好融合身份与真实细节特征。

盲人脸修复(BFR)在生成方法兴起后受到越来越多关注。现有方法多将生成先验融入修复过程,旨在同时处理面部细节生成与身份保持,但常面临视觉质量与身份保真度之间的权衡,导致身份失真或退化去除不充分。本文提出CodeFormer++,一种新框架,在提升修复质量的同时保持身份一致性。将BFR分解为三部分:(i) 保身份的人脸修复,(ii) 高质量人脸生成,(iii) 动态融合身份特征与真实纹理细节。主要贡献包括:(1) 基于学习的可变形人脸对齐模块,实现生成与修复人脸的语义对齐;(2) 纹理引导的修复网络,动态提取并传递生成人脸的纹理以提升保真修复质量;(3) 引入深度度量学习,通过生成信息丰富的正样本与难负样本,优化身份保持与生成特征的融合。在真实世界与合成数据集上的大量实验表明,CodeFormer++在视觉保真度与身份一致性方面均达到更优表现。

原文摘要 · Abstract (English)

Blind face restoration (BFR) has attracted increasing attention with the rise of generative methods. Most existing approaches integrate generative priors into the restoration pro- cess, aiming to jointly address facial detail generation and identity preservation. However, these methods often suffer from a trade-off between visual quality and identity fidelity, leading to either identity distortion or suboptimal degradation removal. In this paper, we present CodeFormer++, a novel framework that maximizes the utility of generative priors for high-quality face restoration while preserving identity. We decompose BFR into three sub-tasks: (i) identity- preserving face restoration, (ii) high-quality face generation, and (iii) dynamic fusion of identity features with realistic texture details. Our method makes three key contributions: (1) a learning-based deformable face registration module that semantically aligns generated and restored faces; (2) a texture guided restoration network to dynamically extract and transfer the texture of generated face to boost the quality of identity-preserving restored face; and (3) the integration of deep metric learning for BFR with the generation of informative positive and hard negative samples to better fuse identity- preserving and generative features. Extensive experiments on real-world and synthetic datasets demonstrate that, the pro- posed CodeFormer++ achieves superior performance in terms of both visual fidelity and identity consistency.

人脸修复生成模型深度度量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。