用合成数据提升人脸识别,解决偏见与复杂场景难题
Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data
- 设计专用于合成数据的新型人脸识别模型
- 合成数据+真实数据组合显著改善跨年龄、遮挡等挑战下的性能
- 适合关注生成式AI与数据增强的研究者
合成数据在人脸识别领域日益流行,主要因其能规避真实数据带来的隐私问题及获取难度,如多样性、质量与人口统计差异等。同时,合成数据可大规模生成且易于定制,更适应特定需求。为有效利用合成数据,需专门设计人脸识别模型以充分挖掘其潜力。为此,我们发起第二届FRCSyn-onGoing挑战,基于CVPR 2024启动的第二届合成数据时代人脸识别挑战(FRCSyn)。该持续性挑战为研究者提供平台,用于评估:一、新型生成式AI方法与合成数据;二、专为利用合成数据而设计的人脸识别系统。重点探索合成数据单独使用或与真实数据结合,应对当前人脸识别中的挑战,包括人口统计偏见、域适应,以及训练测试间年龄差异、姿态变化、遮挡等困难情形。本版取得诸多有趣发现,与第一期相比,此前合成数据库仅限DCFace和GANDiffFace,本期实现更大范围突破。
原文摘要 · Abstract (English)
Synthetic data is gaining increasing popularity for face recognition technologies, mainly due to the privacy concerns and challenges associated with obtaining real data, including diverse scenarios, quality, and demographic groups, among others. It also offers some advantages over real data, such as the large amount of data that can be generated or the ability to customize it to adapt to specific problem-solving needs. To effectively use such data, face recognition models should also be specifically designed to exploit synthetic data to its fullest potential. In order to promote the proposal of novel Generative AI methods and synthetic data, and investigate the application of synthetic data to better train face recognition systems, we introduce the 2nd FRCSyn-onGoing challenge, based on the 2nd Face Recognition Challenge in the Era of Synthetic Data (FRCSyn), originally launched at CVPR 2024. This is an ongoing challenge that provides researchers with an accessible platform to benchmark i) the proposal of novel Generative AI methods and synthetic data, and ii) novel face recognition systems that are specifically proposed to take advantage of synthetic data. We focus on exploring the use of synthetic data both individually and in combination with real data to solve current challenges in face recognition such as demographic bias, domain adaptation, and performance constraints in demanding situations, such as age disparities between training and testing, changes in the pose, or occlusions. Very interesting findings are obtained in this second edition, including a direct comparison with the first one, in which synthetic databases were restricted to DCFace and GANDiffFace.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。