arXiv:2505.20512cs.CV2025-05被引 1

提出无需标签的面部表情识别偏见评估框架,更准确发现模型偏见。

A Feature-level Bias Evaluation Framework for Facial Expression Recognition Models

  • 基于特征层面构建无标签偏见评估方法,避免伪标签干扰。
  • 在大规模数据集上发现年龄、性别、种族三类属性存在显著偏见。
  • 引入可插拔统计模块,确保结果具有统计显著性,适合公平性研究者使用。

近期关于公平性的研究显示,面部表情识别(FER)模型对某些视觉感知的人口群体存在偏见。然而,公共FER数据集中人工标注的人口属性标签有限,限制了偏见分析的范围。为克服这一局限,部分工作采用伪人口属性标签,可能导致评估结果失真。本文提出一种特征级偏见评估框架,在测试集无真实人口标签的情况下评估FER模型的人口偏见。大量实验表明,该方法比依赖伪标签的方法更有效。此外,我们发现许多现有研究未进行统计检验,导致部分报告的偏见可能仅为随机波动。为此,我们引入一个即插即用的统计模块,确保评估结果的统计显著性。基于该模块,我们在大规模数据集上对年龄、性别、种族三类敏感属性,七种面部表情及多种网络架构进行了全面偏见分析,揭示了FER模型中的显著人口偏见,并为选择更公平的网络结构提供了依据。

原文摘要 · Abstract (English)

Recent studies on fairness have shown that Facial Expression Recognition (FER) models exhibit biases toward certain visually perceived demographic groups. However, the limited availability of human-annotated demographic labels in public FER datasets has constrained the scope of such bias analysis. To overcome this limitation, some prior works have resorted to pseudo-demographic labels, which may distort bias evaluation results. Alternatively, in this paper, we propose a feature-level bias evaluation framework for evaluating demographic biases in FER models under the setting where demographic labels are unavailable in the test set. Extensive experiments demonstrate that our method more effectively evaluates demographic biases compared to existing approaches that rely on pseudo-demographic labels. Furthermore, we observe that many existing studies do not include statistical testing in their bias evaluations, raising concerns that some reported biases may not be statistically significant but rather due to randomness. To address this issue, we introduce a plug-and-play statistical module to ensure the statistical significance of biased evaluation results. A comprehensive bias analysis based on the proposed module is then conducted across three sensitive attributes (age, gender, and race), seven facial expressions, and multiple network architectures on a large-scale dataset, revealing the prominent demographic biases in FER and providing insights on selecting a fairer network architecture.

面部识别偏见评估公平性统计检验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。