用合成数据微调大模型,提升人脸识别性能,适配不同数据条件。
IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data

- 用合成数据微调CLIP模型,分全量与有限数据两赛道测试。
- 全量数据下全微调+子中心ArcFace效果最佳,有限数据下秩稳定LoRA最优。
- 结果超越原生模型,适合资源受限场景下的模型优化研究者参考。
本文总结了在2026年国际生物特征会议(IJCB 2026)上举行的「使用合成训练数据适应基础模型进行人脸识别」(AFMFR)竞赛。竞赛共收到四个团队的八份有效提交,分为两个互补赛道:全量数据赛道要求参与者使用大规模合成身份数据微调CLIP ViT-L/14基础模型;有限数据赛道模拟资源受限的适应场景。所有训练数据均通过IDPERTURB生成。各方案依据在多个基准测试集(包括LFW、CFP-FP、AgeDB-30、CALFW、CPLFW、IJB-B、IJB-C和TinyFace)上的验证与识别表现进行排名,采用博达计数法评分。此外,在RFW数据集上对四个种族群体进行了公平性评估。结果显示,使用合成数据微调的CLIP模型显著优于原始模型,在部分任务中甚至超越基线。全量数据赛道中,由DMSTI-Neurotechnology提出的子中心ArcFace全微调方法表现最佳;而在有限数据条件下,Idiap-BSP提出的秩稳定LoRA方法最为有效。
原文摘要 · Abstract (English)
This paper presents a summary of the Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data (AFMFR), held at the 2026 International Joint Conference on Biometrics (IJCB 2026). The competition received a total of eight valid submissions from four distinct teams across two complementary tracks: a Full Data Track, in which participants adapt the CLIP ViT-L/14 foundation model using large-scale synthetic identity data, and a Limited Data Track, designed to reflect more resource-constrained adaptation regimes. All training data was generated exclusively using IDPERTURB. Submitted solutions are ranked based on verification and identification performance across a diverse suite of benchmarks, including LFW, CFP-FP, AgeDB-30, CALFW, CPLFW, IJB-B, IJB-C, and TinyFace, using the Borda count method. Fairness evaluation is additionally conducted on the RFW dataset across four demographic groups. The results demonstrate that adaptation of the CLIP foundation model with synthetic training data substantially improves over the off-the-shelf model and, in several cases, surpasses the baseline. Notably, full fine-tuning with Sub-Center ArcFace (DMSTI-Neurotechnology) leads the Full Data Track, while rank-stabilized LoRA adaptation (Idiap-BSP) proves most effective under limited-data conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。