用少量自拍照片+全局老化模型,实现精准个人化变老效果
MyTimeMachine: Personalized Facial Age Transformation
- 结合全局老化模型与个人照片,通过适配器网络融合特征
- 仅需50张照片即可生成符合目标年龄的逼真人脸图像
- 适用于影视特效等场景,支持视频时序一致性生成
人脸老化过程受性别、种族、生活方式等多重因素影响,难以建立普适的老化先验以准确预测个体老化。现有方法虽能生成逼真结果,但常偏离个人真实样貌,需个性化调整。在影视特效等实际应用中,用户常有20~40年跨度的少量个人照片。然而,直接用这些照片微调全局老化模型常失败。为此,我们提出MyTimeMachine(MyTM),利用最少50张个人照片与全局老化先验,学习个性化老化转换。引入新型适配器网络,融合个性化与全局老化特征,并通过StyleGAN2生成重老化图像。设计三种损失函数:个性化老化损失、外推正则化与自适应w范数正则化,以优化适配器。该方法可扩展至视频,实现高质量、身份保持且时间一致的老化效果,优于当前最优方法。
原文摘要 · Abstract (English)
Facial aging is a complex process, highly dependent on multiple factors like gender, ethnicity, lifestyle, etc., making it extremely challenging to learn a global aging prior to predict aging for any individual accurately. Existing techniques often produce realistic and plausible aging results, but the re-aged images often do not resemble the person's appearance at the target age and thus need personalization. In many practical applications of virtual aging, e.g. VFX in movies and TV shows, access to a personal photo collection of the user depicting aging in a small time interval (20$\sim$40 years) is often available. However, naive attempts to personalize global aging techniques on personal photo collections often fail. Thus, we propose MyTimeMachine (MyTM), which combines a global aging prior with a personal photo collection (using as few as 50 images) to learn a personalized age transformation. We introduce a novel Adapter Network that combines personalized aging features with global aging features and generates a re-aged image with StyleGAN2. We also introduce three loss functions to personalize the Adapter Network with personalized aging loss, extrapolation regularization, and adaptive w-norm regularization. Our approach can also be extended to videos, achieving high-quality, identity-preserving, and temporally consistent aging effects that resemble actual appearances at target ages, demonstrating its superiority over state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。