arXiv:2505.21363cs.LGcs.AI2025-05ICML被引 1

subgroup定义不当会适得其反,影响公平性提升效果

Subgroups Matter for Robust Bias Mitigation

  • 系统测试不同子群体划分对公平性缓解的影响
  • 某些分组反而使偏差恶化,比不处理还差
  • 建议用不同子群进行缓解以实现更好公平性

尽管机器学习中的偏差缓解方法不断涌现,但没有一种方法能始终有效,核心问题仍未解答:何时以及为何这些方法会失败?本文提出假设:许多缓解方法共享一个常被忽视的关键步骤——子群体的定义。我们对多个视觉与语言分类任务中前沿的偏差缓解方法进行了全面评估,系统地改变子群体定义方式,包括粗粒度、细粒度、交叉性及含噪子群。结果表明,子群体选择显著影响性能,某些分组甚至导致比不缓解更差的结果。研究发现,仅观察到子群体间差异,并不足以说明应据此进行缓解。通过理论分析,我们揭示了一个反直觉现象:在某些情况下,针对特定子群体提升公平性,反而需使用另一组子群体进行缓解。本工作强调了子群体定义的重要性,将其视为提升模型鲁棒性与公平性的新调控杠杆。

原文摘要 · Abstract (English)

Despite the constant development of new bias mitigation methods for machine learning, no method consistently succeeds, and a fundamental question remains unanswered: when and why do bias mitigation techniques fail? In this paper, we hypothesise that a key factor may be the often-overlooked but crucial step shared by many bias mitigation methods: the definition of subgroups. To investigate this, we conduct a comprehensive evaluation of state-of-the-art bias mitigation methods across multiple vision and language classification tasks, systematically varying subgroup definitions, including coarse, fine-grained, intersectional, and noisy subgroups. Our results reveal that subgroup choice significantly impacts performance, with certain groupings paradoxically leading to worse outcomes than no mitigation at all. Our findings suggest that observing a disparity between a set of subgroups is not a sufficient reason to use those subgroups for mitigation. Through theoretical analysis, we explain these phenomena and uncover a counter-intuitive insight that, in some cases, improving fairness with respect to a particular set of subgroups is best achieved by using a different set of subgroups for mitigation. Our work highlights the importance of careful subgroup definition in bias mitigation and presents it as an alternative lever for improving the robustness and fairness of machine learning models.

公平性偏差缓解子群体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。