arXiv:2507.19705cs.CV2025-07中稿 · IJCB2025

分析合成人脸检测模型在面部特征上的偏见,揭示其对不同人群的识别差异。

Bias Analysis for Synthetic Face Detection: A Case Study of the Impact of Facial Attributes

  • 构建均衡属性标签的合成数据集,减少训练偏差对检测结果的影响。
  • 五款先进检测器在25个面部属性上均表现出显著偏见,尤其对特定特征敏感。
  • 通过激活图和训练集属性平衡分析,定位偏见来源,适合关注AI公平性的研究者。

合成人脸检测的偏见分析将成为未来关键议题。尽管已有多种检测模型和数据集用于识别合成内容,但一个核心问题被忽视:这些模型与训练数据可能存在偏见,导致对某些人口群体检测失败,引发严重的社会、法律和伦理问题。本文提出一种评估框架,通过生成属性标签均衡的合成数据,缓解数据偏差对偏见分析结果的影响。基于该框架,我们对五款前沿检测器在包含25个受控面部属性的合成数据集上的偏见水平进行了广泛案例研究。结果显示,总体上合成人脸检测器对特定面部属性的存在与否存在明显偏见;同时,通过分析检测器训练集中属性分布的平衡性及图像对中属性修改后的激活图,揭示了偏见产生的根源。

原文摘要 · Abstract (English)

Bias analysis for synthetic face detection is bound to become a critical topic in the coming years. Although many detection models have been developed and several datasets have been released to reliably identify synthetic content, one crucial aspect has been largely overlooked: these models and training datasets can be biased, leading to failures in detection for certain demographic groups and raising significant social, legal, and ethical issues. In this work, we introduce an evaluation framework to contribute to the analysis of bias of synthetic face detectors with respect to several facial attributes. This framework exploits synthetic data generation, with evenly distributed attribute labels, for mitigating any skew in the data that could otherwise influence the outcomes of bias analysis. We build on the proposed framework to provide an extensive case study of the bias level of five state-of-the-art detectors in synthetic datasets with 25 controlled facial attributes. While the results confirm that, in general, synthetic face detectors are biased towards the presence/absence of specific facial attributes, our study also sheds light on the origins of the observed bias through the analysis of the correlations with the balancing of facial attributes in the training sets of the detectors, and the analysis of detectors activation maps in image pairs with controlled attribute modifications.

合成人脸偏见分析公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。