发现人脸性别识别偏差源于社会定义的外貌特征,而非生物差异。
On the Illusion of Gender Bias in Face Recognition: Explaining the Fairness Issue Through Non-demographic Attributes
- 通过解耦40个非性别外貌特征,构建无偏分析工具链
- 特定外貌组合下男女识别率差距消失,证明偏差可消除
- 为算法公平性研究提供新视角,适合关注AI伦理的研究者
人脸识别系统在不同性别用户间存在显著准确率差异,影响系统可信度。现有研究多依赖人工选取、相关性强且规模小的面部特征集,结论可能有偏。本文首次将分析范围扩展至40个非性别面部特征的解耦组合,提出一套工具链以解耦并聚合面部属性,实现大规模数据上的低偏见性别分析。设计两种专用指标,量化面部特征对绝对与相对公平性的影响。进一步提出一种新型无监督联合分析框架,可识别使偏差消失的属性组合,作为平衡测试数据集的筛选条件。实验表明,当男性与女性样本共享特定外貌特征时,性别差距消失,明确说明性能差异并非生物学原因,而是社会对形象的定义所致。该发现重塑了对人脸识别公平性的理解,为解决性别偏差问题提供关键洞见。
原文摘要 · Abstract (English)
Face recognition systems (FRS) exhibit significant accuracy differences based on the user's gender. Since such a gender gap reduces the trustworthiness of FRS, more recent efforts have tried to find the causes. However, these studies make use of manually selected, correlated, and small-sized sets of facial features to support their claims. In this work, we analyze gender bias in face recognition by successfully extending the search domain to decorrelated combinations of 40 non-demographic facial characteristics. First, we introduce a toolchain to effectively decorrelate and aggregate facial attributes to enable a less-biased gender analysis on large-scale data. Second, we tailor two specialized metrics to quantify the effect of facial attributes on absolute and relative fairness. Based on these grounds, we thirdly present a novel unsupervised joint investigation framework capable of identifying attribute combinations leading to vanishing bias when used as filter predicates for balanced testing datasets. Experiments show the gender gap vanishing when images of male and female subjects share specific attributes, clearly indicating that the disparate performance is not a question of biology but of the social definition of appearance. These findings could reshape our understanding of fairness in face biometrics and provide insights into FRS, helping to address gender bias issues.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。