跨语言情感识别中,用元学习提升小样本表现。
A Cross-Lingual Meta-Learning Method Based on Domain Adaptation for Speech Emotion Recognition
- 用大模型+原型网络做元学习,适配少语料场景。
- 在希腊语、罗马尼亚语上达83.78%和56.30%准确率。
- 适合低资源语言情感识别研究者参考。
高性能语音模型通常依赖目标语言的大量数据训练,但多数语言数据稀缺,尤其在语音情感识别领域更为严重。本文针对数据有限场景,探索元学习在语音情感识别、口音识别与身份识别任务中的应用。不同于以往因计算成本高而采用小型模型的做法,本文采用大型预训练主干网络与原型网络相结合的方法,更具实用性。核心贡献在于提出一种改进的元测试阶段微调策略,显著提升模型在分布外数据上的性能。该方法在4分类5样本设定下,对未参与训练/验证的希腊语和罗马尼亚语数据集分别达到83.78%和56.30%的准确率,结合多项改进实现优异效果。
原文摘要 · Abstract (English)
Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in speech emotion recognition. Our work explores the model's performance in limited data, specifically for speech emotion recognition. Meta-learning specializes in improving the few-shot learning. As a result, we employ meta-learning techniques on speech emotion recognition tasks, accent recognition, and person identification. To this end, we propose a series of improvements over the multistage meta-learning method. Unlike other works focusing on smaller models due to the high computational cost of meta-learning algorithms, we take a more practical approach. We incorporate a large pre-trained backbone and a prototypical network, making our methods more feasible and applicable. Our most notable contribution is an improved fine-tuning technique during meta-testing that significantly boosts the performance on out-of-distribution datasets. This result, together with incremental improvements from several other works, helped us achieve accuracy scores of 83.78% and 56.30% for Greek and Romanian speech emotion recognition datasets not included in the training or validation splits in the context of 4-way 5-shot learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。