arXiv:2602.05162cs.CVcs.LG2026-02被引 1

用子模函数挖掘难样本,让人脸识别更公平不偏倚

SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition

  • 将公平学习转化为子模难样本挖掘问题,缓解属性数据不平衡
  • 在CelebA和UTKFace上提升公平性2.7点,准确率提高3.5%
  • 适合关注模型公平性与性能平衡的研究者

深度神经网络常在训练中继承标注数据的社会与人口统计偏差,导致对种族、年龄、性别等敏感属性的不公平预测。现有方法受属性组间数据不平衡影响,无意中强化敏感属性,加剧不公平并降低性能。为此,我们提出SHaSaM(子模难样本挖掘),一种新的组合优化方法,将公平驱动的表征学习建模为子模难样本挖掘问题。其两阶段框架包括:SHaSaM-MINE通过子模子集选择策略挖掘难正负样本,有效缓解数据不平衡;SHaSaM-LEARN引入基于子模条件互信息的组合损失函数,在最大化目标类别判别边界的同时最小化敏感属性影响。该统一范式限制模型学习与敏感属性相关的特征,显著提升公平性且不牺牲性能。在CelebA和UTKFace上的实验表明,SHaSaM实现当前最优结果,公平性(Equalized Odds)最高提升2.7点,准确率提高3.5%,且训练所需轮次更少。

原文摘要 · Abstract (English)

Deep neural networks often inherit social and demographic biases from annotated data during model training, leading to unfair predictions, especially in the presence of sensitive attributes like race, age, gender etc. Existing methods fall prey to the inherent data imbalance between attribute groups and inadvertently emphasize on sensitive attributes, worsening unfairness and performance. To surmount these challenges, we propose SHaSaM (Submodular Hard Sample Mining), a novel combinatorial approach that models fairness-driven representation learning as a submodular hard-sample mining problem. Our two-stage approach comprises of SHaSaM-MINE, which introduces a submodular subset selection strategy to mine hard positives and negatives - effectively mitigating data imbalance, and SHaSaM-LEARN, which introduces a family of combinatorial loss functions based on Submodular Conditional Mutual Information to maximize the decision boundary between target classes while minimizing the influence of sensitive attributes. This unified formulation restricts the model from learning features tied to sensitive attributes, significantly enhancing fairness without sacrificing performance. Experiments on CelebA and UTKFace demonstrate that SHaSaM achieves state-of-the-art results, with up to 2.7 points improvement in model fairness (Equalized Odds) and a 3.5% gain in Accuracy, within fewer epochs as compared to existing methods.

公平性人脸属性子模优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。