用少量迭代的潜在一致性模型,高效生成高保真人脸图像。
Identity-Conditioned Latent Consistency Distillation for Face Synthesis

- 将文本到图像转为身份嵌入到人脸,用教师模型知识蒸馏出学生模型。
- 每图生成仅需0.48秒,速度比原模型快4.36倍,质量仍保持领先。
- 适合需要大量人脸数据的识别系统训练,尤其关注效率与质量平衡。
扩散模型在高保真图像生成中表现优异,但其迭代采样过程计算成本高昂,尤其在生成大规模人脸数据集(如不同姿态、表情、年龄)时更为显著。本文提出一种基于身份条件的潜在一致性模型,通过少次迭代实现高效人脸合成,同时不损失图像质量。训练时,将基础扩散模型Arc2Face(教师模型)的文本到图像流程改造为嵌入到人脸设置,以ArcFace身份嵌入替代文本提示进行知识蒸馏。得到的学生模型平均每张图像推理时间仅为0.4819秒,相比Arc2Face的2.102秒提升4.36倍。定量评估显示,该模型在所有测试协议下均具竞争力:在10万张生成图像上,于CelebA数据集达到13.921(原模型12.928),在WebFace42M上则为9.317(原模型9.802),优于教师模型。在Synth-500和AgeDB上的评估也表明性能接近或相当。结果证明,通过任务特异性潜在一致性知识蒸馏,可大幅加速Arc2Face的同时保持高质量的人脸生成能力。代码已公开于https://github.com/UFPR-IPASP-PR/FaceRec-IdentityConsistency。
原文摘要 · Abstract (English)
Diffusion models have achieved strong results in high-fidelity image synthesis, but their iterative sampling process makes large-scale generation computationally expensive. This limitation is especially relevant when generating synthetic face datasets for face recognition, where a large number of subjects with many samples in different poses, expressions, ages, etc., are required. In this work, we show that identity-conditioned face synthesis can be performed at a substantially lower computational cost by a latent Consistency Model with few iterations, without compromising image quality. For training, we distill knowledge from the foundation Diffusion Model Arc2Face (teacher) by adapting its original text-to-image pipeline to an embedding-to-face setting, replacing textual prompts with ArcFace identity embeddings. Our distilled model (student) generates identity-conditioned face images with an average inference time of 0.4819 seconds per image, compared with 2.102 seconds for Arc2Face, resulting in a 4.36$\times$ speed-up. Quantitative results, based on FID scores, show that the distilled model remains competitive with Arc2Face across all evaluation protocols. On 100k generated images, it achieves near-parity on CelebA (13.921 vs. 12.928) and outperforms the teacher on WebFace42M (9.317 vs. 9.802). Further evaluations on Synth-500 and AgeDB show a moderate performance gap for the former but comparable results for the latter. These results indicate that Arc2Face can be accelerated through task-specific latent consistency distillation while preserving high image quality for large-scale synthetic face generation. Our proposal is publicly available at https://github.com/UFPR-IPASP-PR/FaceRec-IdentityConsistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。