arXiv:2412.06235cs.CVcs.LG2024-12被引 10

用扩散模型生成更公平多样的人脸数据,性能逼近甚至超越真实数据。

VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognition

  • 两阶段扩散架构,通过三个机制提升多样性与公平性
  • 在相同数据量下准确率从0.9200提升至0.9405,接近真实数据表现
  • 首次在多个数据集上超越真实数据,适合隐私敏感的面部识别训练

利用大规模网络爬取数据训练人脸识别模型引发了严重的隐私和偏见问题。合成方法可缓解这些问题,并提供可扩展、可控的人脸生成,以实现公平且准确的人脸识别。然而,现有合成数据集在类内和类间多样性方面表现有限,无法达到真实数据的识别性能。本文提出VariFace,一种基于扩散模型的两阶段生成流程,用于创建公平且多样化的合成人脸数据集以训练人脸识别模型。具体引入三种方法:人脸识别一致性以优化人口属性标签,面间多样性得分引导以增强类间差异,发散得分条件控制以平衡身份保真度与类内多样性。在相同数据集规模下,VariFace显著优于以往合成数据集(0.9200 → 0.9405),并达到与真实数据训练模型相当的性能(真实差距 = -0.0065)。在无约束条件下,VariFace不仅在不同数据规模下持续优于先前合成方法,且首次在六个评估数据集上超越真实数据(CASIA-WebFace):在LFW、CFP-FP、CPLFW、AgeDB、CALFW上平均验证准确率达0.9567(真实差距 = +0.0097),在RFW上达0.9366(真实差距 = +0.0380),创下新基准。

原文摘要 · Abstract (English)

The use of large-scale, web-scraped datasets to train face recognition models has raised significant privacy and bias concerns. Synthetic methods mitigate these concerns and provide scalable and controllable face generation to enable fair and accurate face recognition. However, existing synthetic datasets display limited intraclass and interclass diversity and do not match the face recognition performance obtained using real datasets. Here, we propose VariFace, a two-stage diffusion-based pipeline to create fair and diverse synthetic face datasets to train face recognition models. Specifically, we introduce three methods: Face Recognition Consistency to refine demographic labels, Face Vendi Score Guidance to improve interclass diversity, and Divergence Score Conditioning to balance the identity preservation-intraclass diversity trade-off. When constrained to the same dataset size, VariFace considerably outperforms previous synthetic datasets (0.9200 $\rightarrow$ 0.9405) and achieves comparable performance to face recognition models trained with real data (Real Gap = -0.0065). In an unconstrained setting, VariFace not only consistently achieves better performance compared to previous synthetic methods across dataset sizes but also, for the first time, outperforms the real dataset (CASIA-WebFace) across six evaluation datasets. This sets a new state-of-the-art performance with an average face verification accuracy of 0.9567 (Real Gap = +0.0097) across LFW, CFP-FP, CPLFW, AgeDB, and CALFW datasets and 0.9366 (Real Gap = +0.0380) on the RFW dataset.

人脸生成扩散模型公平性合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。