arXiv:2605.02814cs.CVcs.AI2026-05

用参考图精准恢复人脸身份细节,尤其在严重退化时表现优异。

IConFace: Fine-Grained Identity Conditioning for Reference-Aware Face Restoration

论文配图:IConFace: Fine-Grained Identity Conditioning for Reference-Aware Face Restoration
图 1 · 摘自论文原文
  • 通过融合多张同人参考图与退化图像,实现细粒度身份控制。
  • 在严苛退化条件下,身份细节保留率领先,参考兼容性最优。
  • 适合需要高保真人脸修复的场景,如历史影像重建与隐私保护。

严重的人脸退化会抹除个体特异性特征,使修复任务变得不确定。生成先验虽能恢复清晰且合理的面部,但可能遗漏跨图像持续存在的局部身份特征。同一身份的参考图像可提供缺失证据,而退化观测则锚定目标结构。我们提出 IConFace,一种细粒度身份条件化的框架,可选择性地基于最多三张同人参考图进行修复。其混合拼接骨干网络将退化图像和参考图像作为密集视觉标记保留,以维护局部参考证据。身份路径提供紧凑的多参考引导,退化结构路径注入全视野与局部残差记忆,强化目标对齐结构。我们还引入一个经人工评估的基准,用于衡量持久的局部身份细节是否在修复中得以保留。IConFace 在参考兼容性方面达到领先水平,尤其在严重退化情况下;在该基准上,其观察到的保存率最高。不使用参考图时,它在五个盲修复基准上均达到领先的感知质量。联合参考依赖与成对目标评估表明,参考支持的身份恢复与精确目标一致是互补的。

原文摘要 · Abstract (English)

Severe face degradation can remove person-specific evidence, making restoration underdetermined. A generative prior may recover a sharp, plausible face yet miss localized traits that persist across images of the same person. Same-identity references supply this missing evidence, while the degraded observation anchors target structure. We propose \textbf{IConFace}, a fine-grained identity-conditioned framework that optionally conditions restoration on up to three same-identity references. Its hybrid concat backbone retains degraded and reference observations as dense visual tokens, preserving localized reference evidence. An identity pathway provides compact multi-reference guidance, while a degraded-structure pathway injects full-field and local-residual memories to reinforce target-aligned structure. We also introduce a human-audited benchmark that measures whether persistent localized identity details survive restoration. IConFace achieves leading reference compatibility, especially under severe degradation, and the highest observed preservation rate on this benchmark. Without references, it achieves leading learned perceptual quality across five blind-restoration benchmarks. Joint reference-based and paired-target evaluations show that reference-supported identity recovery and exact target agreement are complementary.

人脸修复身份保持参考图像生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。