arXiv:2501.00995cs.LG2025-01被引 7

研究跨语料库语音情感识别中的性别公平性,发现模型性能与公平性需分别考量。

Is It Still Fair? Investigating Gender Fairness in Cross-Corpus Speech Emotion Recognition

  • 提出联合公平性适应机制,同时优化源域和目标域的性别公平性
  • 实证发现跨语料库模型在性别公平性上存在显著差异
  • 为跨场景情感识别系统设计提供公平性评估新视角

语音情感识别(SER)在众多日常应用中至关重要。跨语料库SER模型因其泛化能力日益受到关注,但其在不同人口统计特征下的公平性引发担忧。现有研究多聚焦于单语料库内的公平性,忽视了跨语料库场景下的可迁移性。本文首次探究跨语料库SER中性别公平性的可迁移性问题,强调模型性能与公平性是两个独立考量维度。我们提出一种联合公平性适应机制,通过同时处理源域和目标域的性别差异,提升迁移学习任务中的性别公平性。实验结果揭示了跨语料库系统在性别公平性上的普遍性挑战,为后续公平性设计提供了重要启示。

原文摘要 · Abstract (English)

Speech emotion recognition (SER) is a vital component in various everyday applications. Cross-corpus SER models are increasingly recognized for their ability to generalize performance. However, concerns arise regarding fairness across demographics in diverse corpora. Existing fairness research often focuses solely on corpus-specific fairness, neglecting its generalizability in cross-corpus scenarios. Our study focuses on this underexplored area, examining the gender fairness generalizability in cross-corpus SER scenarios. We emphasize that the performance of cross-corpus SER models and their fairness are two distinct considerations. Moreover, we propose the approach of a combined fairness adaptation mechanism to enhance gender fairness in the SER transfer learning tasks by addressing both source and target genders. Our findings bring one of the first insights into the generalizability of gender fairness in cross-corpus SER systems.

语音识别公平性跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。