提出两阶段框架,让人脸衰老更真实且保形。
From Cradle to Cane: A Two-Pass Framework for High-Fidelity Lifespan Face Aging
- 分两步生成:先强老化,再保身份,解决年龄与面容的权衡难题。
- 在CelebA-HQ上,年龄准确性和身份一致性均优于现有方法。
- 适合需要高保真人脸老化效果的研究与应用,如影视、医疗。
人脸衰老是计算机视觉中的关键任务,应用涵盖娱乐到医疗。然而,现有方法难以在全生命周期内实现真实无缝的转变,尤其在大龄差或极端姿态下表现不佳。核心挑战在于年龄准确性与身份一致性的平衡——即年龄-身份权衡。多数方法要么牺牲身份保真度强化老化,要么反之。本文提出基于少步文本到图像扩散模型的两阶段框架Cradle2Cane。第一阶段通过自适应噪声注入(AdaNI)机制,结合年龄与性别描述作为文本条件,控制老化强度并提升年龄准确性,但身份保留较弱以支持更强的老化;第二阶段通过两个身份感知嵌入(IDEmb:SVR-ArcFace与Rotate-CLIP)进行条件控制,对第一阶段输出进行去噪,增强身份一致性,同时保留年龄特征。两阶段端到端联合训练。在CelebA-HQ测试集上,经Face++与Qwen-VL协议评估,本方法在年龄准确性和身份一致性上均超越现有方法。代码已开源。
原文摘要 · Abstract (English)
Face aging has become a crucial task in computer vision, with applications ranging from entertainment to healthcare. However, existing methods struggle with achieving a realistic and seamless transformation across the entire lifespan, especially when handling large age gaps or extreme head poses. The core challenge lies in balancing age accuracy and identity preservation--what we refer to as the Age-ID trade-off. Most prior methods either prioritize age transformation at the expense of identity consistency or vice versa. In this work, we address this issue by proposing a two-pass face aging framework, named Cradle2Cane, based on few-step text-to-image (T2I) diffusion models. The first pass focuses on solving age accuracy by introducing an adaptive noise injection (AdaNI) mechanism. This mechanism is guided by including prompt descriptions of age and gender for the given person as the textual condition. Also, by adjusting the noise level, we can control the strength of aging while allowing more flexibility in transforming the face. However, identity preservation is weakly ensured here to facilitate stronger age transformations. In the second pass, we enhance identity preservation while maintaining age-specific features by conditioning the model on two identity-aware embeddings (IDEmb): SVR-ArcFace and Rotate-CLIP. This pass allows for denoising the transformed image from the first pass, ensuring stronger identity preservation without compromising the aging accuracy. Both passes are jointly trained in an end-to-end way. Extensive experiments on the CelebA-HQ test dataset, evaluated through Face++ and Qwen-VL protocols, show that our Cradle2Cane outperforms existing face aging methods in age accuracy and identity consistency. Code is available at https://github.com/byliutao/Cradle2Cane.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。