arXiv:2410.16432cs.LG2024-10NeurIPS被引 10

用博弈论方法同时优化模型准确率与公平性,效果优于现有技术。

Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium

  • 基于双层优化构建公平性与准确率的博弈平衡机制
  • 在成人和健康数据集上显著降低偏差,优于主流公平算法
  • 理论证明其损失上限低于传统正则化方法,适合高公平性要求场景

机器学习中的偏见问题亟需有效解决方案以保障不同群体间的公平对待,尤其在分类任务中。当前去偏方法常导致信息丢失,且难以兼顾准确率与公平性。为此,我们提出一种基于双层优化的新方法——FairBiNN,通过深度学习框架协同优化准确率与公平性目标,在特定假设下可获得已知的帕累托最优解,有效缓解模型偏见。理论分析表明,该方法的损失上界不超过引入正则项的拉格朗日法。我们在UCI Adult和Heritage Health等表格数据集上验证了其有效性,对比最先进公平性算法表现更优,推动了公平感知机器学习的发展,并弥合了准确率与公平性之间的差距。代码已开源:https://github.com/yazdanimehdi/FairBiNN。

原文摘要 · Abstract (English)

The persistent challenge of bias in machine learning models necessitates robust solutions to ensure parity and equal treatment across diverse groups, particularly in classification tasks. Current methods for mitigating bias often result in information loss and an inadequate balance between accuracy and fairness. To address this, we propose a novel methodology grounded in bilevel optimization principles. Our deep learning-based approach concurrently optimizes for both accuracy and fairness objectives, and under certain assumptions, achieving proven Pareto optimal solutions while mitigating bias in the trained model. Theoretical analysis indicates that the upper bound on the loss incurred by this method is less than or equal to the loss of the Lagrangian approach, which involves adding a regularization term to the loss function. We demonstrate the efficacy of our model primarily on tabular datasets such as UCI Adult and Heritage Health. When benchmarked against state-of-the-art fairness methods, our model exhibits superior performance, advancing fairness-aware machine learning solutions and bridging the accuracy-fairness gap. The implementation of FairBiNN is available on https://github.com/yazdanimehdi/FairBiNN.

公平性双层优化模型均衡去偏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。