用僧伽罗语迁移学习提升马尔代夫语语音识别效果
From Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech Recognition

- 从语言相近的僧伽罗语迁移预训练模型,再微调到马尔代夫语
- 最佳方案达12.89%错误率,比纯马尔代夫语基线降低13.50%
- 证明语言相关性是关键,适合低资源语言研究者参考
马尔代夫语(Dhivehi)目前在自动语音识别(ASR)及其他自然语言处理任务中资源匮乏。本研究探讨是否可通过与之语言相关的、资源较丰富的岛国印度-雅利安语——僧伽罗语进行跨语言迁移学习来改善马尔代夫语的语音识别性能。我们设计了十七组实验,涵盖五种迁移学习范式:仅使用马尔代夫语的基线、顺序微调、多语言微调、持续预训练,以及以土耳其语为无关语言的对照实验。最强系统为在僧伽罗语上持续预训练后,再在马尔代夫语上微调,并结合KenLM解码,达到12.89%的词错误率(WER)和2.70%的字符错误率(CER),相较马尔代夫语独有基线分别降低13.50%与3.02%。土耳其对照实验确认,性能提升源于语言相关性;适应策略与解码配置同样关键。
原文摘要 · Abstract (English)
Dhivehi, the national language of the Maldives, is currently under-resourced for automatic speech recognition (ASR) and other NLP tasks. This study investigates whether cross-lingual transfer learning from Sinhala, a linguistically related, relatively well-resourced Insular Indo-Aryan language, can improve Dhivehi ASR. We conduct seventeen experiments across five transfer learning paradigms: Dhivehi-only baselines, sequential fine-tuning, multilingual fine-tuning, continual pre-training, and a control using Turkish as an unrelated language. The strongest system, continual pre-training on Sinhala followed by fine-tuning on Dhivehi with KenLM, achieves 12.89% WER and 2.70% CER, outperforming the Dhivehi-only baseline by 13.50% WER and 3.02% CER. However, the adaptation strategy and decoding configuration are equally critical for a successful transfer learning experiment. We conduct seventeen controlled experiments spanning five transfer learning paradigms: Dhivehi-only baselines, sequential fine-tuning, multilingual fine-tuning, continual pre-training, and a control experiment using Turkish as an unrelated language. The strongest system, continual pre-training on Sinhala followed by fine-tuning on Dhivehi with KenLM, achieves 12.89% WER and 2.70% CER, outperforming the Dhivehi-only baseline by 13.50% WER and 3.02% CER. The Turkish control experiment confirms that observed improvements stem from linguistic relatedness; adaptation strategy and decoding configuration are also critical.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。