arXiv:2505.18469cs.CV2025-05被引 1

提出一键扩散模型HonestFace,让修复人脸更真实可信。

HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model

  • 用身份嵌入和掩码对齐,保留原图特征并增强细节
  • 在多参考真实数据集上超越现有方法,视觉与定量指标双优
  • 适合需要高保真、不捏造细节的图像修复场景

人脸修复经过多年发展已取得显著进展,但在极端退化情况下,如何在保持高保真度的同时避免伪影仍具挑战,尤其需模型对低质量输入做出更「诚实」的重建,准确反映原始特征。本文提出HonestFace,一种兼顾身份一致性和真实纹理的一键扩散人脸修复方法。首先,设计身份嵌入模块,有效捕捉低质输入与多个参考人脸的关键身份特征;其次,提出掩码人脸对齐方法,提升细粒度细节与纹理真实性。此外,构建新数据集MultiRefCeleb-Test,包含多个高质量参考图像与低质输入。在该框架下,HonestFace在面部保真度与真实感方面表现优异。实验表明,本方法在视觉质量与量化评估上均优于当前最优方法。代码与预训练模型已公开于https://github.com/jkwang28/HonestFace。

原文摘要 · Abstract (English)

Face restoration has achieved significant advancements through the years of development. However, maintaining high fidelity and authenticity while avoiding artifacts remains challenging, especially in extreme degradation scenarios. This highlights the need for models that are more ``honest'' in their reconstruction from low-quality inputs, accurately reflecting original characteristics. In this work, we propose HonestFace, a novel approach for honest face restoration with identity consistency and realistic textures. To achieve this, HonestFace incorporates several key components. First, we propose an identity embedder to effectively capture and preserve crucial identity features from both the low-quality input and multiple reference faces. Second, a masked face alignment method is presented to enhance fine-grained details and textural authenticity. Furthermore, we present a new real-world reference-based face restoration dataset, \textbf{MultiRefCeleb-Test}, with multiple high-quality references and low-quality inputs. Leveraging these contributions within a one-step diffusion model framework, HonestFace delivers excellent restoration results in terms of facial fidelity and realism. Experiments demonstrate that our approach surpasses state-of-the-art methods, achieving superior performance in both visual quality and quantitative assessments. The code and pre-trained models are available at https://github.com/jkwang28/HonestFace .

人脸修复扩散模型真实感生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。