调控对话中的停顿与重叠能显著提升语音识别效果。
On the Role of Conversational Timing in Synthetic Training Data for ASR
- 用指数倾斜模型参数化对话的停顿和重叠模式
- 重叠越多,错误率越低;停顿越长越不规则,错误率越高
- 适合优化语音识别训练数据的对话时序设计
合成多说话人对话被广泛用于训练对话式自动语音识别(ASR)系统,但何种对话时序特性使模拟数据最有效仍不明确。本文将对话时序视为可控制的训练变量,而非仅需复现的语料统计特征。通过从多个对话语料中估计指数倾斜族参数化停顿与重叠分布,并利用拉丁超立方采样和多目标贝叶斯优化探索四维参数空间。每组采样配置生成模拟训练对话,训练ASR系统,并在匈牙利对话语料上评估拼接-置换词错误率(cpWER)和字符错误率(cpCER)。结果表明,下游ASR表现更直接由诱导出的时序统计特征解释,而非原始模拟器坐标或语料相似度。具体而言,更高的重叠暴露与更低的cpWER相关,而更长且更不规则的间隙则导致更高的cpWER;cpCER呈现相同趋势,但统计支持较弱。贝叶斯优化带来适度的整体提升,其主要价值在于分析:它生成了受控的时序干预,揭示了模拟对话训练数据中重叠与间隙间的权衡关系。研究建议,真实模拟应辅以针对重叠、间隙及时间变异性特征的任务相关诊断。
原文摘要 · Abstract (English)
Synthetic multi-speaker conversations are widely used to train conversational automatic speech recognition (ASR) systems, but it remains unclear which timing properties make simulated data most useful. This paper studies conversational timing as a controllable training variable rather than merely as a corpus statistic to be reproduced. We parameterize pause and overlap timing distributions with an exponential-tilting family estimated from multiple conversational corpora, and then explore the resulting four-dimensional parameter space with Latin hypercube sampling and multi-objective Bayesian optimization. Each sampled timing configuration is used to generate simulated training conversations, train an ASR system, and evaluate concatenated-permutation word and character error rates (cpWER and cpCER) on a Hungarian dialogue corpus. The results show that downstream ASR behavior is explained more directly by induced timing statistics than by raw simulator coordinates or corpus proximity. In particular, higher overlap exposure is associated with lower cpWER, whereas longer and more variable gaps are associated with higher cpWER; cpCER follows the same trend, but with weaker statistical support. Bayesian optimization yields modest aggregate improvements, but its main value is analytical: it produces controlled timing interventions that reveal an overlap--gap trade-off in simulated conversational training data. These findings suggest that realistic simulation should be complemented by task-relevant diagnostics of overlap, gap, and timing-variability profiles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。