无需标注数据,揭示普通话方言语音表征的细微差异。
Probing in the Wild: A Case Study of Self-Supervised Speech Representations on Mandarin Sub-dialects with Unsupervised Articulatory Analysis
- 用通用音素识别器生成音素序列,自动映射为发音特征向量。
- 北京话发音特征解码度显著高于其他方言,声学显著特征更稳定。
- 适合研究方言差异、自监督语音模型内部机制的研究者。
尽管自监督语音模型在各类语音任务中表现优异,但其在细粒度方言变异下的内部语音表征行为仍不明确。现有探针研究多依赖人工标注的语料库,难以适用于自然方言语音。本文提出一种完全无标注的探针流程,使用语言无关的通用音素识别器生成音素序列,并映射为发音特征向量,实现无需人工标注的帧级探针。结果表明,普通话子方言间发音特征可解码性呈现结构性模式:唇音性和嘶音性等声学显著特征相对稳定,而与精细频谱差异相关的特征则表现出更大方言差异。这种差异主要源于北京话相对于其他方言更高的解码度。层间分析显示不同特征组具有不同的表征动态。研究说明语言无关的发音探针可应用于真实世界方言语料,且自监督语音表征对方言的敏感性在发音维度上分布不均。
原文摘要 · Abstract (English)
While self-supervised speech models have achieved strong performance across speech tasks, relatively little is known about how their internal phonetic representations behave under fine-grained dialect variation. Existing probing studies typically rely on curated corpora with manual phonetic annotations, limiting their applicability to naturally occurring dialect speech. We present a case study of articulatory feature representations in a Mandarin self-supervised speech model using an entirely unlabeled probing pipeline. Phone sequences are generated using a language-agnostic universal phone recognizer and mapped to articulatory feature vectors, enabling frame-level probing without manual annotation. Our results reveal a structured pattern in articulatory feature decodability across Mandarin sub-dialects. Acoustically salient features such as labiality and stridency remain comparatively stable, whereas features associated with finer spectral distinctions exhibit larger dialect-dependent variation. This variation is driven primarily by elevated decodability for Beijing speech relative to other Mandarin sub-dialects. Layer-wise analyses further show distinct representational dynamics for these feature groups. These findings suggest that language-agnostic articulatory probing can be applied to real-world dialect corpora and that dialect sensitivity in self-supervised speech representations is unevenly distributed across articulatory dimensions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。