优化阿拉伯语古兰经语音识别,准确率提升近5个百分点。
A Comparative Study of Pretrained Transformer Models for Quranic ASR: Speech Representations, Label Formats, and Dataset Composition

- 用Wav2Vec2等自监督模型提取声学特征,结合领域微调。
- 最佳配置在关键数据集上达到0.08的词错误率,较基线降低5%。
- 适合做古兰经语音转写、诵读纠错与宗教文本搜索系统。
古兰经自动语音识别(ASR)旨在将古兰经诵读转化为文本,支持记忆辅助和检索应用。但现有模型在用户诵读时错误率高,且未覆盖完整经文。本文系统研究了基于Transformer的预训练模型在古兰经领域的微调效果,采用Wav2Vec2.0、HuBERT和XLS-R等先进声学特征提取方法。这些模型通过掩码输入音频并利用Transformer学习上下文感知的语音表示。在超过870小时的专业与用户诵读数据上进行微调,并通过全面消融实验分析特征提取器、标签格式、训练策略和片段时长的影响。最优配置在EveryAyah子集上实现0.08的词错误率(WER),在EveryAyah+Tarteel组合设置下为0.11,相比Citrinet基线(WER=0.163)提升约5个百分点,同时将联合模型训练时间从140小时缩短至40小时。无符号阿拉伯文表现最佳,且Wav2Vec2-XLSR-53提供最强整体表征。未来工作包括提升数据质量,开发音素感知模型以支持发音规则敏感应用。
原文摘要 · Abstract (English)
Quran Automatic Speech Recognition (ASR) aims to convert Quranic recitation into text, enabling applications such as aided memorisation tools and Quranic search engines. However, existing ASR models often exhibit high Word Error Rates (WER) on user-recited verses and lack full coverage of the Quranic corpus. This paper presents a systematic empirical study of domain-specific fine-tuning of pretrained Transformer-based models for Quranic ASR, using advanced speech feature extraction methods: Wav2Vec2.0, HuBERT, and XLS-R. These models apply self-supervised learning by masking portions of input audio and using Transformer architectures to learn context-aware speech features. The pretrained models are fine-tuned on a filtered Quranic dataset exceeding 870 hours of professional and user recitations. Through comprehensive ablation studies across feature extractors, output label formats, training strategies, and clip durations, we identify the key factors that affect transcription accuracy in this domain. Our best-performing configuration achieves a WER of 0.08 on the EveryAyah subset and 0.11 on the combined EveryAyah+Tarteel setting, representing roughly a five-percentage-point gain over the Citrinet baseline (WER = 0.163) while reducing combined-model training time from 140 hours to 40 hours. Arabic text without diacritics yields the best fine-tuning results, and Wav2Vec2-XLSR-53 provides the strongest overall representation. Future work includes improving dataset quality and developing phoneme-aware models to extract deeper speech feature representations for Tajweed-sensitive applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。