用音节结构解码器提升越南语语音识别,更准且词表更小。
Syllabic-Structure Decoder for Automatic Speech Recognition in Vietnamese
- 基于音素构建音节结构解码器,替代传统字词预测
- 在两个数据集上超越强基线,词表缩小但性能不降
- 适合研究越南语语音识别或小词表建模的学者
大多数自动语音识别(ASR)系统将转录视为对正字法单位(如字符、子词或词语)的预测问题。尽管有效,这类表示未显式反映语音的语音学结构,常需大词表以保证覆盖度。本文受越南语音素特征启发,提出一种音节结构解码器,将语音建模从正字法层面转向音素层面。该方法显式捕捉音节的音韵构成,使解码器能从紧凑的音素词表中生成合法音节结构。这一设计更贴近语音的实际发音机制,同时显著降低词表规模。在两个基准数据集(标准语音的LSVSC,以及包含多方言发音的UIT-ViMD)上的实验结果表明,本方法持续优于先前强基线,包括PhoWhisper和Wav2Vec2等预训练模型,即便使用更小的词表且无额外训练资源。这些结果验证了音素级音节建模在越南语ASR中的有效性。代码将在论文接收后公开。
原文摘要 · Abstract (English)
Most Automatic Speech Recognition (ASR) systems formulate transcription as a prediction problem over orthographic units such as characters, subwords, or words. Although effective, such representations do not explicitly reflect the phonetic structure of speech and often require large vocabularies to maintain adequate coverage. In this work, we are motivated from the phonemic features of Vietnamese to propose a Syllabic-Structure Decoder for ASR, which models speech at the phoneme level instead of the orthographic level. Our approach explicitly captures the phonological composition of syllables, enabling the decoder to generate valid syllabic structures from a compact phonemic inventory. This design more closely aligns with the phonetic realization of speech while significantly reducing vocabulary size. Experimental results on two benchmarks: LSVSC, representing standard speech, and UIT-ViMD, a multi-dialect corpus containing diverse regional pronunciations, show that our method consistently outperforms strong previous baselines, especially pretrained baselines such as PhoWhisper and Wav2Vec2, despite using a substantially smaller vocabulary and no additional training resources. These results highlight the effectiveness of phoneme-based syllabic modeling for ASR in this language. Code for experimental reproducibility will be publicly available upon the acceptance of this paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。