构建平衡数据集,显著降低性别分类模型的偏见。
Auditing and Mitigating Bias in Gender Classification Algorithms: A Data-Centric Approach
- 通过融合多个数据集,构建覆盖189个年龄/种族/性别交集的均衡数据集
- 在新数据集上训练模型,使种族间真阳性率差距减少超50%
- 公开可用,适合关注公平性的人工智能研究者使用
性别分类系统常继承训练数据中的群体失衡问题。我们审计了五个常用性别分类数据集,发现均存在显著的交叉性低估问题。为评估其下游影响,我们在最均衡的两个数据集UTKFace和FairFace上训练相同MobileNetV2模型,结果表明即使如此,模型仍对女性面孔误判率更高,并加剧了既有种族偏见。为此,我们构建了BalancedFace,一个新公开数据集,通过融合FairFace、UTKFace及其他来源图像,填补缺失群体空白,仅使用真实未编辑图像,实现189个年龄、种族、性别交集的子群比例均衡。在该数据集上训练的标准分类器,将最大种族子群真阳性率差距降低超过50%,平均差异影响得分比次优数据集接近理想值1.0达63%,且整体准确率损失极小。结果凸显数据驱动干预的深远价值,为公平性别分类研究提供开放资源。
原文摘要 · Abstract (English)
Gender classification systems often inherit and amplify demographic imbalances in their training data. We first audit five widely used gender classification datasets, revealing that all suffer from significant intersectional underrepresentation. To measure the downstream impact of these flaws, we train identical MobileNetV2 classifiers on the two most balanced of these datasets, UTKFace and FairFace. Our fairness evaluation shows that even these models exhibit significant bias, misclassifying female faces at a higher rate than male faces and amplifying existing racial skew. To counter these data-induced biases, we construct BalancedFace, a new public dataset created by blending images from FairFace and UTKFace, supplemented with images from other collections to fill missing demographic gaps. It is engineered to equalize subgroup shares across 189 intersections of age, race, and gender using only real, unedited images. When a standard classifier is trained on BalancedFace, it reduces the maximum True Positive Rate gap across racial subgroups by over 50% and brings the average Disparate Impact score 63% closer to the ideal of 1.0 compared to the next-best dataset, all with a minimal loss of overall accuracy. These results underline the profound value of data-centric interventions and provide an openly available resource for fair gender classification research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。