用合成语音训练小型固定音色泰语语音合成模型,实现无需参考音频的本地化语音生成。
Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech
- 以大模型生成合成语音,训练小型固定音色学生模型
- 8200万参数模型在泰语关键词准确率达68.2%,接近主流模型的90%
- 适合资源受限场景下的泰语语音合成开发,支持设备端部署
在低资源环境下,语音合成通常需在高成本的大规模语音克隆模型与依赖特定说话人语料的小型固定音色系统之间取舍。本文探索第三种路径:利用大型语音克隆模型作为可编程数据源,仅用15秒短语音参考,完全基于合成语音训练一个紧凑的固定音色学生模型。该设定下,管道设计至关重要:教师模型错误会成为训练目标,而过滤失败生成可能降低对复杂文本的覆盖。泰语还面临词边界模糊、声调、专有名词与外来词、数字发音及泰英混用等挑战。我们研究了文本预处理、合成生成、质量过滤、拒绝采样和前端选择对最终学生模型的影响,并揭示教师模型的局限性。评估指标包括词错误率(CER)、挑战集关键词准确率、韵律停顿准确率、说话人相似度与语速。最终模型Wayu-Paxa-TTS-Edge(82M参数)可在设备端运行且无需参考音频,实现68.2%挑战集关键词准确率(为Gemini 3.1的85.5%),停顿精度达91.4%,优于其OmniVoice教师模型(89.9%),并达到Gemini 3.1的94.8%。其停顿定位误差与词内停顿率均最低,泰语与英语的CER分别为3.7%和1.1%。模型与评估框架已开源。
原文摘要 · Abstract (English)
In low-resource settings, deploying TTS typically requires choosing between a large voice-cloning model with costly inference or a compact fixed-voice system that requires a speaker-specific corpus. We study a third route: using a large voice-cloning model as a programmable data source to turn a short voice reference (e.g., 15 seconds) into a compact fixed-voice student trained entirely on synthetic speech. This setting makes pipeline design consequential: teacher errors become training targets, while filtering failed generations can reduce coverage of difficult texts. Thai further introduces challenges from ambiguous word boundaries, lexical tone, names and loanwords, numeric verbalization, and Thai-English code-switching. We study how text preparation, synthetic generation, quality filtering, rejection sampling, and frontend choices affect the resulting student, and where teacher limitations remain. We evaluate CER, Challenge-Set Keyword Accuracy, Prosody Pause Accuracy, speaker similarity, and speaking rate. The resulting 82M-parameter model, Wayu-Paxa-TTS-Edge, enables on-device Thai TTS without reference audio. It achieves 68.2% Challenge-Set Keyword Accuracy (85.5% of Gemini 3.1) and 91.4% pause precision, outperforming its OmniVoice teacher (89.9%) and reaching 94.8% of Gemini 3.1. It also achieves the lowest pause-placement error and intra-word pause rates among the three systems, and 3.7% and 1.1% CER on Thai and English, respectively. We open-source the model and evaluation framework for Thai TTS development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。