arXiv:2603.30032cs.CLcs.SD2026-03

通过精准调控语速提升听觉理解力,且不被察觉。

Covertly improving intelligibility with data-driven adaptations of speech timing

  • 基于数据驱动方法,发现语速调整在不同时间窗有相反影响。
  • 针对性语速调节使二语听众理解力提升,且未被察觉。
  • 适用于听力障碍或非母语者,可推广至各类语音系统。

人类说话者常通过整体放慢语速来帮助听觉困难者(如听力障碍或非母语成人)理解。然而,这种策略是否真能提高理解力尚不明确。本文利用机器生成语音的高精度控制能力,系统研究了针对性语速调整对理解力的影响。首先,通过逆相关实验发现,在目标元音对比(如紧松对立)前,语速的时间影响呈现剪刀状模式:早期和晚期语境窗口效应相反;该模式在母语英语者及法语、汉语、日语背景的二语英语者中均稳定存在。其次,该语速结构不仅提升二语者对目标元音对比的理解,母语者在恶劣声学条件下也依赖此模式。最后,我们构建了一种数据驱动的文本到语音算法,复现该时间结构于新语音序列中。在多种句子和元音对比任务中,听众均未察觉语速调整,反而认为普遍放慢更清晰,但实际其导致更多理解错误。结果表明,针对性语速调整显著提升复杂条件下的理解力,且常不被察觉。本研究提供了一种数据驱动的语音可访问性优化方法,可拓展至其他语音理解维度与多样听众环境。

原文摘要 · Abstract (English)

Human talkers often address listeners with language-comprehension challenges, such as hard-of-hearing or non-native adults, by globally slowing down their speech. However, it remains unclear whether this strategy actually makes speech more intelligible. Here, we take advantage of recent advancements in machine-generated speech allowing more precise control of speech rate in order to systematically examine how targeted speech-rate adjustments may improve comprehension. We first use reverse-correlation experiments to show that the temporal influence of speech rate prior to a target vowel contrast (ex. the tense-lax distinction) in fact manifests in a scissor-like pattern, with opposite effects in early versus late context windows; this pattern is remarkably stable both within individuals and across native L1-English listeners and L2-English listeners with French, Mandarin, and Japanese L1s. Second, we show that this speech rate structure not only facilitates L2 listeners' comprehension of the target vowel contrast, but that native listeners also rely on this pattern in challenging acoustic conditions. Finally, we build a data-driven text-to-speech algorithm that replicates this temporal structure on novel speech sequences. Across a variety of sentences and vowel contrasts, listeners remained unaware that such targeted slowing improved word comprehension. Strikingly, participants instead judged the common strategy of global slowing as clearer, even though it actually increased comprehension errors. Together, these results show that targeted adjustments to speech rate significantly aid intelligibility under challenging conditions, while often going unnoticed. More generally, this paper provides a data-driven methodology to improve the accessibility of machine-generated speech which can be extended to other aspects of speech comprehension and a wide variety of listeners and environments.

语音生成语速调控可访问性二语理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。