提出高效框架BADR,实现任意公平性度量下的最优帕累托模型。
Fairness-informed Pareto Optimization : An Efficient Bilevel Framework
- 通过双层自适应重标定机制,统一处理不同公平性度量。
- 在多个数据集上超越现有方法,实现更高公平性与性能平衡。
- 开源工具包支持多种任务与度量,适合研究与应用者使用。
尽管前景广阔,现有公平机器学习方法常产生帕累托无效模型——即某些群体性能可提升而不损害其他群体。这一问题在传统内处理方法(如公平性正则化)中频发。相比之下,现有帕累托有效方法对特定公平性视角存在偏倚,难以适配文献中广泛研究的各类公平性度量。本文提出BADR框架,可为任意公平性度量恢复最优帕累托有效模型。其核心为双层自适应重标定过程:下层为加权经验风险最小化,权重为各群体的凸组合;上层优化选定的公平性目标。我们设计两种大规模单循环算法BADR-GD与BADR-SGD,建立收敛性保证。同时发布badr开源Python工具包,支持多种学习任务与公平性度量。大量数值实验表明,BADR在帕累托有效性方面显著优于现有方法。
原文摘要 · Abstract (English)
Despite their promise, fair machine learning methods often yield Pareto-inefficient models, in which the performance of certain groups can be improved without degrading that of others. This issue arises frequently in traditional in-processing approaches such as fairness-through-regularization. In contrast, existing Pareto-efficient approaches are biased towards a certain perspective on fairness and fail to adapt to the broad range of fairness metrics studied in the literature. In this paper, we present BADR, a simple framework to recover the optimal Pareto-efficient model for any fairness metric. Our framework recovers its models through a Bilevel Adaptive Rescalarisation procedure. The lower level is a weighted empirical risk minimization task where the weights are a convex combination of the groups, while the upper level optimizes the chosen fairness objective. We equip our framework with two novel large-scale, single-loop algorithms, BADR-GD and BADR-SGD, and establish their convergence guarantees. We release badr, an open-source Python toolbox implementing our framework for a variety of learning tasks and fairness metrics. Finally, we conduct extensive numerical experiments demonstrating the advantages of BADR over existing Pareto-efficient approaches to fairness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。