让合成人脸既多样又保真,提升隐私保护下的识别模型训练效果
ID$^3$: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognition
- 设计保持身份一致性的损失函数,生成多样化人脸图像
- 在5个基准上验证,合成数据分布逼近真实人脸分布
- 适合需要隐私保护的面部识别数据生成场景
合成人脸识别(SFR)旨在生成模仿真实人脸分布的合成人脸数据集,以实现隐私保护下的面部识别模型训练。尽管扩散模型在图像生成中表现卓越,现有基于扩散的SFR模型在泛化到真实世界人脸方面仍存在不足。为此,我们提出SFR的三个关键目标:(1) 跨身份多样性(跨类多样性),(2) 每个身份内通过注入不同面部属性实现多样性(类内多样性),(3) 保持每个身份组内的身份一致性(类内身份保真)。受此启发,我们提出一种扩散驱动的SFR模型ID³。ID³采用身份保持损失,生成多样且身份一致的人脸外观。理论上,最小化该损失等价于最大化调整后条件对数似然的下界。这一等价性推动了身份保持采样算法的设计,其在调整后的梯度场中运行,可生成逼近真实人脸分布的伪造人脸识别数据集。在五个挑战性基准上的大量实验验证了ID³的优势。
原文摘要 · Abstract (English)
Synthetic face recognition (SFR) aims to generate synthetic face datasets that mimic the distribution of real face data, which allows for training face recognition models in a privacy-preserving manner. Despite the remarkable potential of diffusion models in image generation, current diffusion-based SFR models struggle with generalization to real-world faces. To address this limitation, we outline three key objectives for SFR: (1) promoting diversity across identities (inter-class diversity), (2) ensuring diversity within each identity by injecting various facial attributes (intra-class diversity), and (3) maintaining identity consistency within each identity group (intra-class identity preservation). Inspired by these goals, we introduce a diffusion-fueled SFR model termed $\text{ID}^3$. $\text{ID}^3$ employs an ID-preserving loss to generate diverse yet identity-consistent facial appearances. Theoretically, we show that minimizing this loss is equivalent to maximizing the lower bound of an adjusted conditional log-likelihood over ID-preserving data. This equivalence motivates an ID-preserving sampling algorithm, which operates over an adjusted gradient vector field, enabling the generation of fake face recognition datasets that approximate the distribution of real-world faces. Extensive experiments across five challenging benchmarks validate the advantages of $\text{ID}^3$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。