用向量生成30万张虚拟人脸,提升人脸识别模型性能
Vec2Face: Scaling Face Dataset Generation with Loosely Constrained Vectors
- 仅需随机向量输入,通过自编码器与解码器生成人脸图像
- 生成30万唯一身份,比前人多5倍,且每身份有合理外观变化
- 合成数据训练的模型在多个测试集超越真实数据训练效果
本文研究如何合成不存在人物的面部图像,以构建可用于有效训练人脸识别(FR)模型的数据集。除了生成逼真的人脸图像外,还需满足两个关键目标:1)生成大量区分度高的身份(跨类分离),2)每个身份内具备合理的外观变化(类内差异)。现有方法通常受限于可生成的清晰分离身份数量,或依赖外部模型进行属性增强。本文提出Vec2Face,一个仅需采样向量作为输入的端到端模型,能灵活生成并控制人脸身份及其属性。该模型由特征掩码自编码器和图像解码器组成,基于人脸图像重建进行监督,推理使用便捷。通过输入低相似性向量,可生成区分良好的身份;在小范围内随机扰动输入向量,即可生成同一身份下的多样化图像。还可通过梯度下降调整向量值,生成指定属性的人脸。该方法已高效生成多达30万个人脸身份,远超此前最大6万的规模。基于生成的HSFace数据集(10k至300k身份)训练的FR模型,在五个真实测试集(LFW、CFP-FP、AgeDB-30、CALFW、CPLFW)上达到92%至93.52%的准确率,达到当前最优水平。首次实现使用合成数据训练的FR模型,在CALFW、IJBB和IJBC测试集上优于同规模真实数据训练模型。
原文摘要 · Abstract (English)
This paper studies how to synthesize face images of non-existent persons, to create a dataset that allows effective training of face recognition (FR) models. Besides generating realistic face images, two other important goals are: 1) the ability to generate a large number of distinct identities (inter-class separation), and 2) a proper variation in appearance of the images for each identity (intra-class variation). However, existing works 1) are typically limited in how many well-separated identities can be generated and 2) either neglect or use an external model for attribute augmentation. We propose Vec2Face, a holistic model that uses only a sampled vector as input and can flexibly generate and control the identity of face images and their attributes. Composed of a feature masked autoencoder and an image decoder, Vec2Face is supervised by face image reconstruction and can be conveniently used in inference. Using vectors with low similarity among themselves as inputs, Vec2Face generates well-separated identities. Randomly perturbing an input identity vector within a small range allows Vec2Face to generate faces of the same identity with proper variation in face attributes. It is also possible to generate images with designated attributes by adjusting vector values with a gradient descent method. Vec2Face has efficiently synthesized as many as 300K identities, whereas 60K is the largest number of identities created in the previous works. As for performance, FR models trained with the generated HSFace datasets, from 10k to 300k identities, achieve state-of-the-art accuracy, from 92% to 93.52%, on five real-world test sets (\emph{i.e.}, LFW, CFP-FP, AgeDB-30, CALFW, and CPLFW). For the first time, the FR model trained using our synthetic training set achieves higher accuracy than that trained using a same-scale training set of real face images on the CALFW, IJBB, and IJBC test sets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。