arXiv:2507.08866cs.LGcs.CY2025-07中稿 · Expert Systems wit…被引 5

提出数据偏见画像,系统识别影响算法歧视的关键因素

Underrepresentation, Label Bias, and Proxies: Towards Data Bias Profiles for the EU AI Act and Beyond

  • 区分三类数据偏见:少数群体欠代表、标签偏差、代理变量
  • 发现代理变量与标签偏差组合比欠代表更易引发歧视
  • 构建数据偏见画像(DBP)工具,助力政策与模型优化

数据中隐含的不良偏见是算法歧视的主要成因。尽管学界和法规普遍重视,但数据偏见仍研究不足,制约了检测与缓解方法的发展。本文分析三种常见数据偏见在多种数据集、模型和公平性度量下的独立与联合影响。结果表明,弱势群体在训练集中欠代表的情况,其导致歧视的程度低于传统认知;而代理变量与标签偏差的组合则更具破坏性。为此,我们设计了针对性检测机制,并整合为初步的「数据偏见画像」(Data Bias Profile, DBP)。通过主流公平性数据集的案例研究,验证了DBP在预测歧视风险及指导公平性干预方面的有效性。该工作从数据视角连接算法公平性研究与反歧视政策。

原文摘要 · Abstract (English)

Undesirable biases encoded in the data are key drivers of algorithmic discrimination. Their importance is widely recognized in the algorithmic fairness literature, as well as legislation and standards on anti-discrimination in AI. Despite this recognition, data biases remain understudied, hindering the development of computational best practices for their detection and mitigation. In this work, we present three common data biases and study their individual and joint effect on algorithmic discrimination across a variety of datasets, models, and fairness measures. We find that underrepresentation of vulnerable populations in training sets is less conducive to discrimination than conventionally affirmed, while combinations of proxies and label bias can be far more critical. Consequently, we develop dedicated mechanisms to detect specific types of bias, and combine them into a preliminary construct we refer to as the Data Bias Profile (DBP). This initial formulation serves as a proof of concept for how different bias signals can be systematically documented. Through a case study with popular fairness datasets, we demonstrate the effectiveness of the DBP in predicting the risk of discriminatory outcomes and the utility of fairness-enhancing interventions. Overall, this article bridges algorithmic fairness research and anti-discrimination policy through a data-centric lens.

算法公平性数据偏见AI治理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。