用张量与贝叶斯回归评估肤色公平性,避免粗略分类偏差
Evaluating Fairness and Mitigating Bias in Machine Learning: A Novel Technique using Tensor Data and Bayesian Regression
- 将肤色表示为概率分布,用统计距离衡量公平性
- 通过贝叶斯回归估计色距,减少模型对肤色的隐性偏见
- 适用于图像分类中非类别属性的公平性评估,适合算法伦理研究者
公平性是可信人工智能的关键。本文聚焦机器学习在处理肤色时的表现,指出肤色在计算机视觉中以张量形式存在,不同于性别、种族等类别属性。现有公平性研究多针对类别特征,难以处理肤色这类连续张量数据。为此,本文提出一种无需标注的新方法:将肤色张量转化为概率分布,采用统计距离度量公平性,捕捉组内与组间细微差异。同时,提出基于多项式贝叶斯回归的训练策略,利用颜色距离估计缓解传统肤色分类带来的潜在偏见,实现更精细、更均衡的肤色建模。
原文摘要 · Abstract (English)
Fairness is a critical component of Trustworthy AI. In this paper, we focus on Machine Learning (ML) and the performance of model predictions when dealing with skin color. Unlike other sensitive attributes, the nature of skin color differs significantly. In computer vision, skin color is represented as tensor data rather than categorical values or single numerical points. However, much of the research on fairness across sensitive groups has focused on categorical features such as gender and race. This paper introduces a new technique for evaluating fairness in ML for image classification tasks, specifically without the use of annotation. To address the limitations of prior work, we handle tensor data, like skin color, without classifying it rigidly. Instead, we convert it into probability distributions and apply statistical distance measures. This novel approach allows us to capture fine-grained nuances in fairness both within and across what would traditionally be considered distinct groups. Additionally, we propose an innovative training method to mitigate the latent biases present in conventional skin tone categorization. This method leverages color distance estimates calculated through Bayesian regression with polynomial functions, ensuring a more nuanced and equitable treatment of skin color in ML models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。