针对失语症语音识别数据少难题,用四种增强方法提升识别准确率。
Improving End-to-End Speech Recognition for Dysarthric Speech through In-Domain Data Augmentation
- 按失语症严重程度定制语音增强策略,提升模型适应性。
- 低中度用语速调节,重度用音高调节,错误率分别降低30%、16.6%。
- 实证表明语音增强对失语症语音识别有效,适合康复与辅助技术研究者。
失语症语音识别对改善患者沟通至关重要,但因严重程度差异大且数据稀缺,识别难度高。本文通过微调端到端预训练的Wav2Vec2模型,探索四种针对失语症特征的数据增强方法:语速调节(SRM)、音高调节(PM)、共振峰调节(FM)和声道长度扰动(VTLP)。以各严重程度单独微调的Wav2Vec2为基线,进一步使用增强数据进行针对性微调。结果表明,不同方法在不同严重程度下表现各异:低度(9.02% WER)与中度(38.11% WER)采用SRM(s=0.8),相对改善30.02%与16.64%;高度(55.15% WER)采用PM(τ=0.8),改善15.47%。验证了增强方法在提升失语症语音识别性能上的有效性。
原文摘要 · Abstract (English)
Dysarthric speech recognition is crucial for facilitating effective communication among individuals with dysarthria. However, accurately recognizing dysarthric speech poses significant challenges due to varying severity levels and limited data availability. In this paper, we explore data augmentation techniques for dysarthric automatic speech recognition (ASR) systems by fine-tuning the End-to-End pre-trained Wav2Vec2 model, with a specific focus on severity levels. To address the challenges of data scarcity and the need for extensive data in fine-tuning pre-trained ASR systems for dysarthric speech, we investigate four prominent data augmentation methods: Speaking-Rate Modification (SRM), Pitch Modification (PM), Formant Modification (FM), and vocal tract Length Perturbation (VTLP), tailored to different aspects of dysarthria. The study uses individually fine-tuned Wav2Vec2 models for each severity class as baseline systems. Additionally, we conducted severity-specific fine-tuning of the ASR model using augmented data. Results demonstrate distinct efficacy patterns for each augmentation technique across severity levels. The best WERs were achieved with SRM ($s$=0.8) for \textit{low} (9.02\%) and \textit{medium} (38.11\%) severities, and with PM ($τ$=0.8) for \textit{high} severity (55.15\%), reflecting relative improvements of 30.02\%, 16.64\%, and 15.47\%, respectively. These results confirm the effectiveness of the augmentation methods in improving dysarthric ASR performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。