arXiv:2503.03446cs.CVcs.CY2025-03被引 3

研究数据偏见如何影响面部表情识别模型的公平性

Biased Heritage: How Datasets Shape Models in Facial Expression Recognition

  • 通过控制数据集偏差训练模型,分析偏差传播路径
  • 发现刻板印象偏差比代表性偏差更易传入模型预测
  • 强调应优先消除情绪相关的性别/种族偏见,适合做AI伦理研究者

近年来,人工智能系统快速发展引发了对其公平性的担忧,即如何避免基于性别、种族或年龄等受保护特征的歧视。尽管算法公平性在表格数据的简单二分类任务中已有深入研究,但在复杂的现实场景如面部表情识别(FER)中的应用仍不充分。FER具有多分类特性,且偏见在多重人口统计变量间交叉存在,每个变量可能包含多个受保护群体。本文提出一个全面框架,用于分析图像型FER系统中从数据集到模型的偏见传播,并引入专为多类别问题与多个人口群体设计的新偏见度量指标。方法包括:(1) 在FER数据集中引入可控偏见,(2) 在这些有偏数据上训练模型,(3) 分析数据集偏见指标与模型公平性概念之间的相关性。结果表明,刻板印象偏差比代表性偏差更强烈地传递至模型预测,提示应优先防范特定情绪下的身份偏见,而非仅追求整体人口平衡。此外,有偏数据导致模型准确率下降,挑战了公平性与准确性之间的传统权衡假设。

原文摘要 · Abstract (English)

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or age. While algorithmic fairness is well-studied in simple binary classification tasks on tabular data, its application to complex, real-world scenarios-such as Facial Expression Recognition (FER)-remains underexplored. FER presents unique challenges: it is inherently multiclass, and biases emerge across intersecting demographic variables, each potentially comprising multiple protected groups. We present a comprehensive framework to analyze bias propagation from datasets to trained models in image-based FER systems, while introducing new bias metrics specifically designed for multiclass problems with multiple demographic groups. Our methodology studies bias propagation by (1) inducing controlled biases in FER datasets, (2) training models on these biased datasets, and (3) analyzing the correlation between dataset bias metrics and model fairness notions. Our findings reveal that stereotypical biases propagate more strongly to model predictions than representational biases, suggesting that preventing emotion-specific demographic patterns should be prioritized over general demographic balance in FER datasets. Additionally, we observe that biased datasets lead to reduced model accuracy, challenging the assumed fairness-accuracy trade-off.

面部表情识别算法公平性数据偏见

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。