arXiv:2603.06901stat.MLcs.LG2026-03

公平算法可能适得其反,导致整体结果变差。

Fairness May Backfire: When Leveling-Down Occurs in Fair Machine Learning

  • 用贝叶斯框架分析公平性约束的系统影响
  • 属性盲模型下公平性可能让两组同时变差
  • 揭示了隐藏候选者如何引发‘向下拉平’

随着机器学习系统日益影响信贷、就业等机会的分配,算法决策的公平性成为核心关切。然而,何时强制公平性约束能真正改善受影响群体的处境,还是导致‘向下拉平’(即一个或两个群体状况恶化)仍不明确。本文在二分类任务下,基于主流群体公平性概念,提出统一的贝叶斯级(人口层面)分析框架。该方法无分布假设且与算法无关,剥离了有限样本噪声及训练和干预细节的影响。我们分析了两种常见部署场景:敏感属性可用(属性感知)和不可用(属性盲)。结果显示,在属性感知情形下,公平性必然(弱)提升弱势群体结果,(弱)恶化优势群体结果;而在属性盲情形下,公平性影响依赖于数据分布:可能对任一群体有益或有害,甚至使两组同向变动,导致向上或向下拉平。我们刻画了这些模式出现的条件,并强调‘隐藏候选人’的关键作用。总体而言,研究为公平算法设计与部署提供了结构性指导,明确何时追求公平可改善群体结果,何时可能引发系统性向下拉平。

原文摘要 · Abstract (English)

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these systems genuinely improves outcomes for affected groups or instead leads to "leveling down," making one or both groups worse off. We address this question in a unified, population-level (Bayes) framework for binary classification under prevalent group fairness notions. Our Bayes approach is distribution-free and algorithm-agnostic, isolating the intrinsic effect of fairness requirements from finite-sample noise and from training and intervention specifics. We analyze two deployment regimes for ML classifiers under common legal and governance constraints: attribute-aware decision-making (sensitive attributes available at decision time) and attribute-blind decision-making (sensitive attributes excluded from prediction). We show that, in the attribute-aware regime, fair ML necessarily (weakly) improves outcomes for the disadvantaged group and (weakly) worsens outcomes for the advantaged group. In contrast, in the attribute-blind regime, the impact of fairness is distribution-dependent: fairness can benefit or harm either group and may shift both groups' outcomes in the same direction, leading to either leveling up or leveling down. We characterize the conditions under which these patterns arise and highlight the role of "masked" candidates in driving them. Overall, our results provide structural guidance on when pursuing algorithmic fairness is likely to improve group outcomes and when it risks systemic leveling down, informing fair ML design and deployment choices.

公平性机器学习风险评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。