arXiv:2506.01655eess.AScs.SD2025-06

用自监督模型自动评估语音质量,无需人工打分。

Self-Supervised Speech Quality Assessment (S3QA): Leveraging Speech Foundation Models for a Scalable Speech Quality Metric

  • 基于WavLM提取语音嵌入,用余弦距离量化降质程度。
  • 在多种噪声、混响等条件下,预测结果与人工评分高度相关。
  • 适合语音识别、助听设备等需大规模质量评估的场景。

自动评估真实环境中的语音质量对构建鲁棒的人机交互技术至关重要。虽然人类主观评分(如平均意见分,MOS)被视为金标准,但其受评价者差异影响大、难以跨语料库推广且收集成本高,限制了可评估的声学挑战范围。本文提出一种可扩展的自监督语音质量评估方法(S3QA):首先,从多个语音语料库中选取高质量语句,施加频率滤波、混响、背景噪声和数字压缩等多种真实世界常见的降质处理;其次,利用预训练的语音基础模型WavLM,在嵌入空间计算干净与降质语音间的余弦距离,作为自监督训练目标;接着,训练一个Transformer模型仅根据降质语音预测该距离;最后,在未见的合成数据集NISQA和VOiCES上进行评估。结果表明,S3QA模型在广泛声学条件下能准确预测降质距离,且与行为评分(MOS)、语音识别性能及其他特征(如麦克风距离)高度一致。该方法为跨多种声学挑战的语音质量自动化评估提供了可行方案。

原文摘要 · Abstract (English)

Methods for automatically assessing speech quality in real world environments are critical for developing robust human language technologies and assistive devices. Behavioral ratings provided by human raters (e.g., mean opinion scores; MOS) are considered the gold standard, but they are susceptible to variability between individual raters, cannot easily be generalized across corpora, and are labor-intensive to collect, thus limiting the acoustic challenges they can quantify. Here, we present a new, scalable method for automatically assessing speech quality: the self-supervised speech quality assessment (S3QA) model. First, we manipulated high quality utterances from multiple speech corpora, using a wide range of acoustic challenges intended to emulate common sources of quality degradation in the real-world: frequency filtering, reverberation, background noise, and digital compression. Second, we leveraged an existing, pre-trained speech foundation model, WavLM, to computationally derive a self-supervised training target that quantified speech degradation using the cosine distance between the clean and degraded versions of each utterance in the embedding space. Next, we trained a transformer-based model to predict these cosine distances, given only the degraded versions of the utterances. Finally, the trained model was evaluated on unseen test corpora of synthetic mixtures, NISQA, and VOiCES. We show that the S3QA model trained on this task accurately predicts degradation cosine distances across a wide range challenging acoustic conditions and is aligned with both behavioral ratings (MOS), speech technology performance (automatic speech recognition) and other important features of the held-out data (e.g., microphone distances). This model provides an automated, scalable method for assessing speech quality across a wide range of acoustic challenges.

语音质量自监督学习语音评估WavLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。