arXiv:2503.02870stat.MLcs.LG2025-03ICML被引 1

用代理属性评估和提升模型在缺失敏感信息时的公平性

Multiaccuracy and Multicalibration via Proxy Groups

  • 用代理属性推导真实公平性偏差的上限
  • 调整模型在代理属性上的表现可显著降低真实偏差
  • 适用于敏感数据缺失的高风险决策场景

随着机器学习算法在高风险决策中的广泛应用,确保其在敏感群体间的公平性至关重要。然而,由于敏感群体信息缺失或不完整,实际应用中公平性度量与保障面临挑战。代理敏感属性被提出作为可行解决方案,但仅适用于基于均等性的公平性概念。本文首次将该方法扩展至更灵活的多准确性(multiaccuracy)和多校准性(multicalibration)框架。我们证明,在缺乏真实敏感群体数据的情况下,可通过代理属性推导出真实多准确性与多校准性偏差的可操作上界,从而揭示模型潜在最坏情况下的公平性问题。同时,通过在代理属性上满足多准确性与多校准性,能有效缓解真实敏感群体的偏差。我们在多个真实数据集上验证了该方法的有效性,即使在敏感数据不完整或不可用时,仍可实现近似多准确性与多校准性。

原文摘要 · Abstract (English)

As the use of predictive machine learning algorithms increases in high-stakes decision-making, it is imperative that these algorithms are fair across sensitive groups. However, measuring and enforcing fairness in real-world applications can be challenging due to the missing or incomplete sensitive group information. Proxy-sensitive attributes have been proposed as a practical and effective solution in these settings, but only for parity-based fairness notions. Knowing how to evaluate and control for fairness with missing sensitive group data for newer, different, and more flexible frameworks, such as multiaccuracy and multicalibration, remain unexplored. In this work, we address this gap by demonstrating that in the absence of sensitive group data, proxy-sensitive attributes can provably used to derive actionable upper bounds on the true multiaccuracy and multicalibration violations, providing insights into a predictive model's potential worst-case fairness violations. Additionally, we show that adjusting models to satisfy multiaccuracy and multicalibration across proxy-sensitive attributes can significantly mitigate these violations for the true, but unknown, sensitive groups. Through several experiments on real-world datasets, we illustrate that approximate multiaccuracy and multicalibration can be achieved even when sensitive group data is incomplete or unavailable.

公平性代理属性多校准缺失数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。