arXiv:2605.01597eess.AScs.SD2026-05综述被引 1

系统梳理语音AI中的公平性问题,构建统一评估与缓解框架。

Toward Fair Speech Technologies: A Comprehensive Survey of Bias and Fairness in Speech AI

论文配图:Toward Fair Speech Technologies: A Comprehensive Survey of Bias and Fairness in Speech AI
图 1 · 摘自论文原文
  • 提出适配语音特性的七类公平性定义,覆盖生成与感知任务。
  • 识别出声道偏差、标注主观性等语音领域特有的偏见机制。
  • 按四个干预阶段梳理缓解策略,适合研究者与工程师参考。

语音技术广泛应用于高风险场景,但公平性问题分散于不同任务与学科之间。现有综述或采用通用机器学习视角而忽略语音特性,或聚焦单一任务而遗漏跨领域的共性失败模式。本文综合400余篇研究,涵盖语音生成与感知任务及新兴语音-语言模型,提出一个统一框架,将形式化公平性定义与评估、诊断、缓解相衔接。我们为语音模态形式化了七种公平性定义,并通过鲁棒性、表征、治理三大学派组织领域概念演进。进一步将评估指标基于这些定义的数学内核,归类为六种类型,并映射每类指标所对应的具体定义。沿语音处理流程诊断偏见来源,揭示声道偏差作为人口统计学代理、情感标签标注主观性等语音特有机制。系统化梳理四个干预阶段的缓解策略,并与已识别的偏见源对齐。最后,指出开放挑战并提出未来研究方向。

原文摘要 · Abstract (English)

Speech technologies are deployed in high-stakes settings, yet fairness concerns remain fragmented across tasks and disciplines. Existing surveys either adopt a general machine-learning perspective that overlooks speech-specific properties or focus on a single task, missing failure patterns shared across the speech domain. Synthesizing over 400 studies spanning generation and perception tasks and emerging speech-language models, this survey presents a unified framework that links formal fairness definitions to evaluation, diagnosis, and mitigation. We formalize seven fairness definitions adapted to the speech modality and organize the field's conceptual expansion through three paradigms: Robustness, Representation, and Governance. We then ground evaluation metrics in the mathematical cores of these definitions, organizing them into six families and mapping each family back to the definitions it operationalizes. We diagnose bias sources along the speech processing pipeline, surfacing speech-specific mechanisms such as channel bias as a demographic proxy and annotation subjectivity in emotion labels. We systematize mitigation strategies across four intervention stages, mapping each to the diagnosed sources. Finally, we identify open challenges and propose directions for future research.

语音公平性偏见诊断伦理框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。