arXiv:2509.22061eess.AScs.CL2025-09中稿 · Identity-Aware AI …

首次系统评估语音续写中的性别与音质偏见,发现女性语音续写更倾向回归标准发音。

Speak Your Mind: The Speech Continuation Task as a Probe of Voice-Based Model Bias

  • 通过语音续写任务,直接探测语音模型在性别和音质上的表现差异。
  • 女性语音提示的续写更强烈地回归标准发音,呈现系统性音质偏见。
  • 当连贯性达标后,模型在代理权和句义极性上仍显性别差异,适合关注伦理的开发者参考。

语音续写(SC)是在保持语义上下文和说话人身份的前提下,对一段口语提示生成连贯延续的任务。由于仅依赖单一音频流,相比对话任务,SC为探测语音基础模型中的偏见提供了更直接的场景。本文首次系统评估了语音续写中的偏见,研究了性别和发声类型(气息声、破音、末尾破音)对续写行为的影响。我们在三个近期模型(SpiritLM(base 和 expressive)、VAE-GSLM、SpeechGPT)上评估了说话人相似度、语音质量保留以及基于文本的偏见指标。结果显示,尽管说话人相似度和连贯性仍是挑战,但当连贯性足够高时(如 VAE-GSLM),性别效应在代理权和句子极性等文本指标中显现。此外,女性提示的续写比男性更强烈地回归到标准发声模式,揭示出系统性的语音质量偏见。这些发现表明,语音续写是探测语音基础模型中社会相关表征偏见的有力诊断工具,并随着续写质量提升而愈发重要。

原文摘要 · Abstract (English)

Speech Continuation (SC) is the task of generating a coherent extension of a spoken prompt while preserving both semantic context and speaker identity. Because SC is constrained to a single audio stream, it offers a more direct setting for probing biases in speech foundation models than dialogue does. In this work we present the first systematic evaluation of bias in SC, investigating how gender and phonation type (breathy, creaky, end-creak) affect continuation behaviour. We evaluate three recent models: SpiritLM (base and expressive), VAE-GSLM, and SpeechGPT across speaker similarity, voice quality preservation, and text-based bias metrics. Results show that while both speaker similarity and coherence remain a challenge, textual evaluations reveal significant model and gender interactions: once coherence is sufficiently high (for VAE-GSLM), gender effects emerge on text-metrics such as agency and sentence polarity. In addition, continuations revert toward modal phonation more strongly for female prompts than for male ones, revealing a systematic voice-quality bias. These findings highlight SC as a controlled probe of socially relevant representational biases in speech foundation models, and suggest that it will become an increasingly informative diagnostic as continuation quality improves.

语音续写偏见检测语音模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。