融合两种不同生成器的合成人脸数据,提升识别模型多样性与性能
Enhancing Domain Diversity in Synthetic Data Face Recognition with Dataset Fusion
- 用两种不同架构的生成器合成数据并融合,减少单一生成器带来的偏差
- 在多个标准测试集上表现优于仅用单一生成器的数据训练的模型
- 适合关注合成数据质量与隐私安全的人脸识别研究者
尽管近年来人脸识别系统的准确率显著提升,但训练所用数据通常通过网络爬取获得,缺乏用户明确同意,引发伦理与隐私问题。为此,许多近期方法探索使用合成数据训练人脸识别模型。然而,这些模型性能通常低于真实数据训练的模型。一个常见限制是:通常仅使用单一生成器构建整个合成数据集,导致模型特定的伪影,可能使模型过拟合于生成器的固有偏见与特征。本文提出一种解决方案:将两种基于不同架构主干网络生成的先进合成人脸数据集进行融合。该融合策略降低了模型特定伪影,提升了姿态、光照和人口统计学特征的多样性,并通过强调身份相关特征对人脸识别模型起到隐式正则化作用。我们在标准人脸识别基准上评估了基于该融合数据集训练的模型性能,结果表明,该方法在多个基准上均取得更优表现。
原文摘要 · Abstract (English)
While the accuracy of face recognition systems has improved significantly in recent years, the datasets used to train these models are often collected through web crawling without the explicit consent of users, raising ethical and privacy concerns. To address this, many recent approaches have explored the use of synthetic data for training face recognition models. However, these models typically underperform compared to those trained on real-world data. A common limitation is that a single generator model is often used to create the entire synthetic dataset, leading to model-specific artifacts that may cause overfitting to the generator's inherent biases and artifacts. In this work, we propose a solution by combining two state-of-the-art synthetic face datasets generated using architecturally distinct backbones. This fusion reduces model-specific artifacts, enhances diversity in pose, lighting, and demographics, and implicitly regularizes the face recognition model by emphasizing identity-relevant features. We evaluate the performance of models trained on this combined dataset using standard face recognition benchmarks and demonstrate that our approach achieves superior performance across many of these benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。