arXiv:2502.19803cs.CV2025-02ICLR被引 4

用新方法生成更多样化的合成人脸,提升识别准确率。

UIFace: Unleashing Inherent Model Capabilities to Enhance Intra-Class Diversity in Synthetic Face Recognition

  • 通过两种采样策略结合,兼顾身份一致性与类内多样性
  • 仅用一半数据量就超越现有方法,且生成图像更丰富
  • 适合需要隐私保护的面部识别数据生成场景

人脸识别是计算机视觉的重要应用,近年因大规模人脸数据集而显著提升。但直接使用真实数据存在隐私和法律风险。生成合成数据训练模型是可行方案,但现有方法常因上下文过拟合导致生成图像类内多样性不足,影响识别性能。本文提出UIFace框架,通过训练扩散模型实现基于身份上下文或可学习空上下文的采样:前者保持身份一致但缺乏变化,后者激发模型内在生成多样性的能力但身份随机。推理时采用两阶段采样策略,充分融合两者优势,生成既保身份又具多样性的图像。进一步引入注意力注入模块,利用空上下文的注意力图引导身份条件生成,增强类内差异。实验表明,本方法在更少训练数据和半量合成数据下显著优于先前方法;当合成身份数增加时,性能甚至接近基于真实数据训练的模型。

原文摘要 · Abstract (English)

Face recognition (FR) stands as one of the most crucial applications in computer vision. The accuracy of FR models has significantly improved in recent years due to the availability of large-scale human face datasets. However, directly using these datasets can inevitably lead to privacy and legal problems. Generating synthetic data to train FR models is a feasible solution to circumvent these issues. While existing synthetic-based face recognition methods have made significant progress in generating identity-preserving images, they are severely plagued by context overfitting, resulting in a lack of intra-class diversity of generated images and poor face recognition performance. In this paper, we propose a framework to Unleash Inherent capability of the model to enhance intra-class diversity for synthetic face recognition, shortened as UIFace. Our framework first trains a diffusion model that can perform sampling conditioned on either identity contexts or a learnable empty context. The former generates identity-preserving images but lacks variations, while the latter exploits the model's intrinsic ability to synthesize intra-class-diversified images but with random identities. Then we adopt a novel two-stage sampling strategy during inference to fully leverage the strengths of both types of contexts, resulting in images that are diverse as well as identitypreserving. Moreover, an attention injection module is introduced to further augment the intra-class variations by utilizing attention maps from the empty context to guide the sampling process in ID-conditioned generation. Experiments show that our method significantly surpasses previous approaches with even less training data and half the size of synthetic dataset. The proposed UIFace even achieves comparable performance with FR models trained on real datasets when we further increase the number of synthetic identities.

人脸识别生成模型数据增强扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。