揭示语音识别幻觉的机制:最后一层编码器失效是关键
The Anatomy of an ASR Hallucination
- 分析两个独立训练的识别器,发现最后一层编码器是输出是否接地的关键
- 绕过最后一层编码器导致几乎每条语音都产生混乱或重复输出
- 适合关注语音识别可靠性与模型可解释性的研究者阅读
语音识别系统有时会产生与实际语音无关但流畅的文本,这类现象被视为更广泛的语义脱节结果之一,即转录结果不再被音频有效引导。为理解这一失效如何发生,我们研究了两个独立训练的 Conformer-Large 识别器——一个基于 CTC,一个基于 RNN-T——在环境退化和说话人-背景变化下的表现。结果发现,最终编码阶段成为关键分界点:绕过该阶段会导致几乎所有语句出现偏差,而跳过中间层影响甚微。在此阶段,表示变得更紧凑,文本对解码器变得可读,音素信息也变得明确。重要的是,干预后产生的是乱码或重复输出,而非流畅的虚构内容。因此,研究识别出幻觉的机制性前提——输出未能充分接地——而非自然幻觉的全部成因。结果表明,在两种解码器架构及多种分布偏移下,可靠识别均依赖于终端阶段的正常运作。
原文摘要 · Abstract (English)
ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided by the audio. To understand where this failure becomes possible, we study two independently trained Conformer-Large recognizers - one CTC and one RNN-T - under environmental degradation and speaker-background shift. In both models, the final encoder stage emerges as a critical boundary: bypassing the final block causes divergence on nearly every utterance, whereas bypassing middle blocks has little effect. At this same stage, the representations become more compact, text becomes readable by the trained decoder, and grapheme information becomes explicit. Importantly, the intervention produces garbled or repetitive output rather than fluent fabrication. Our result therefore identifies a mechanistic precondition for hallucination - the failure to produce adequately grounded output - not the complete origin of naturally occurring hallucinations. Together, the results reveal a consistent terminal-stage dependency for grounded recognition across two decoder families and multiple distribution shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。