arXiv:2409.18470cs.LG2024-09被引 15

无敏感属性时,用置信度分层训练提升模型公平性

Fairness without Sensitive Attributes via Knowledge Sharing

  • 基于高/低置信度样本构建双模型分层学习机制
  • 在COMPAS和New Adult数据集上同时提升准确率与公平性
  • 适用于敏感信息缺失场景,适合隐私保护型公平建模

尽管模型公平性改进已有研究,但现有方法均依赖显式敏感属性值进行调整。然而随着数据隐私关注度上升,敏感人口信息正日益难以获取。本文提出一种基于置信度的分层分类器结构Reckoner,用于在敏感属性缺失假设下实现可靠的公平模型学习。实验发现,若数据集存在偏见标签或其他隐藏偏见,分类器在高置信度子集中的预测会显著加剧不同人群间的偏见差距。受此启发,我们设计了双模型系统:以高置信度数据初始化的模型从以低置信度数据初始化的模型中学习,从而避免偏见预测。实验表明,Reckoner在COMPAS和New Adult数据集上均持续优于当前最优基线,在准确率与公平性指标上表现更优。

原文摘要 · Abstract (English)

While model fairness improvement has been explored previously, existing methods invariably rely on adjusting explicit sensitive attribute values in order to improve model fairness in downstream tasks. However, we observe a trend in which sensitive demographic information becomes inaccessible as public concerns around data privacy grow. In this paper, we propose a confidence-based hierarchical classifier structure called "Reckoner" for reliable fair model learning under the assumption of missing sensitive attributes. We first present results showing that if the dataset contains biased labels or other hidden biases, classifiers significantly increase the bias gap across different demographic groups in the subset with higher prediction confidence. Inspired by these findings, we devised a dual-model system in which a version of the model initialised with a high-confidence data subset learns from a version of the model initialised with a low-confidence data subset, enabling it to avoid biased predictions. Our experimental results show that Reckoner consistently outperforms state-of-the-art baselines in COMPAS dataset and New Adult dataset, considering both accuracy and fairness metrics.

公平性无敏感属性置信度分层学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。