arXiv:2504.12458cs.LG2025-04被引 1

用极小极大优化提升梯度提升模型的群体公平性。

M$^2$FGB: A Min-Max Gradient Boosting Framework for Subgroup Fairness

  • 引入极小极大公平项,统一优化损失与公平性目标。
  • 理论证明算法在温和条件下收敛,实测对二分类和子群公平有效。
  • 适合关注模型公平性的研究者与工程团队使用。

近年来,机器学习中的公平性成为关键问题,旨在确保预测模型不歧视边缘化群体。本文将子群公平性概念应用于梯度提升机,提出一种通用框架,通过结合传统损失(如分类、回归)与极小极大公平项,扩展梯度提升方法的应用范围。研究了该极小极大优化问题解的理论性质,每轮提升中同时求解原始-对偶问题。该框架可适配多种公平性定义。所提出的极小极大原始-对偶梯度提升算法在温和条件下被证明具有收敛性,并在实验中展现出强大的灵活性与有效性,适用于二分类及子群公平性任务。

原文摘要 · Abstract (English)

In recent years, fairness in machine learning has emerged as a critical concern to ensure that developed and deployed predictive models do not have disadvantageous predictions for marginalized groups. It is essential to mitigate discrimination against individuals based on protected attributes such as gender and race. In this work, we consider applying subgroup justice concepts to gradient-boosting machines designed for supervised learning problems. Our approach expanded gradient-boosting methodologies to explore a broader range of objective functions, which combines conventional losses such as the ones from classification and regression and a min-max fairness term. We study relevant theoretical properties of the solution of the min-max optimization problem. The optimization process explored the primal-dual problems at each boosting round. This generic framework can be adapted to diverse fairness concepts. The proposed min-max primal-dual gradient boosting algorithm was theoretically shown to converge under mild conditions and empirically shown to be a powerful and flexible approach to address binary and subgroup fairness.

公平性梯度提升优化子群

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。