让人脸修复跨越年龄差距,保持身份一致且符合目标年龄。
MeInTime: Bridging Age Gap in Identity-Preserving Face Restoration
- 分离身份与年龄建模,用新注意力机制注入身份特征。
- 在跨年龄修复中,身份保真度和年龄一致性均优于现有方法。
- 无需训练的采样策略,通过年龄提示引导修复过程。
为更好保留个体身份,人脸修复已从无参考转向基于参考的方法,利用同身份高质量参考图像提升恢复结果的身份保真度。然而,现有方法隐含假设参考图与退化输入年龄一致,限制了其在真实场景(如历史照片修复)中的应用。本文提出MeInTime,一种基于扩散模型的跨年龄人脸修复方法,可在仅提供少量参考图及对应年龄提示的情况下,实现高保真的身份与年龄一致性修复。具体而言,我们解耦身份与年龄条件建模:训练阶段通过新引入的注意力机制有效注入身份特征,并采用门控残差融合模块促进退化特征与身份表征的整合;推理阶段提出无训练的年龄感知梯度引导策略,利用年龄驱动方向迭代调整身份感知去噪潜在表示,使其逼近目标年龄语义流形。大量实验表明,MeInTime在身份保真度与年龄一致性方面均优于现有方法。代码已开源。
原文摘要 · Abstract (English)
To better preserve an individual's identity, face restoration has evolved from reference-free to reference-based approaches, which leverage high-quality reference images of the same identity to enhance identity fidelity in the restored outputs. However, most existing methods implicitly assume that the reference and degraded input are age-aligned, limiting their effectiveness in real-world scenarios where only cross-age references are available, such as historical photo restoration. This paper proposes MeInTime, a diffusion-based face restoration method that extends reference-based restoration from same-age to cross-age settings. Given one or few reference images along with an age prompt corresponding to the degraded input, MeInTime achieves faithful restoration with both identity fidelity and age consistency. Specifically, we decouple the modeling of identity and age conditions. During training, we focus solely on effectively injecting identity features through a newly introduced attention mechanism and introduce Gated Residual Fusion modules to facilitate the integration between degraded features and identity representations. At inference, we propose Age-Aware Gradient Guidance, a training-free sampling strategy, using an age-driven direction to iteratively nudge the identity-aware denoising latent toward the desired age semantic manifold. Extensive experiments demonstrate that MeInTime outperforms existing face restoration methods in both identity preservation and age consistency. Our code is available at: https://github.com/teer4/MeInTime
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。