首个大规模泰语情感识别语料库,含2.8万条标注语音。
THAI Speech Emotion Recognition (THAI-SER) corpus
- 构建100位演员在多种环境下录制的41小时泰语语音数据集
- 经筛选后标注一致性达0.692(Krippendorff's alpha),人类识别准确率77.2%
- 适用于泰语语音情感分析研究,开源可复用
我们提出了首个大规模泰语语音情感识别语料库THAI-SER,包含41小时36分钟(27,854条语音)的录音,来自100段不同环境下的录制(Zoom及两种演播室)。录音包含脚本和即兴内容,由200名专业演员(112名女性,88名男性,年龄18至55岁)在专业导演指导下完成。每条语音标注五种主要情绪:中性、愤怒、快乐、悲伤、沮丧。采用众包方式标注情绪类别,并设计严格的过滤与质量控制流程,确保多数人一致度高于0.71。评估指标包括标注者间可靠性(使用Krippendorff's alpha计算)和人类识别准确率。过滤后,Krippendorff's alpha达到0.692,超过推荐值0.667;人类识别准确率达0.772。同时提供在语料库内和跨语料库设置下训练模型的结果。该语料库及实验代码以Creative Commons BY-SA 4.0协议公开。
原文摘要 · Abstract (English)
We present the first sizeable corpus of Thai speech emotion recognition, THAI-SER, containing 41 hours and 36 minutes (27,854 utterances) from 100 recordings made in different recording environments: Zoom and two studio setups. The recordings contain both scripted and improvised sessions, acted by 200 professional actors (112 females and 88 males, aged 18 to 55) and were directed by professional directors. There are five primary emotions: neutral, angry, happy, sad, and frustrated, assigned to the actors when recording utterances. The utterances are annotated with an emotional category using crowdsourcing. To control the annotation process's quality, we also design an extensive filtering and quality control scheme to ensure that the majority agreement score remains above 0.71. We evaluate our annotated corpus using two metrics: inter-annotator reliability and human recognition accuracy. Inter-annotator reliability score was calculated using Krippendorff's alpha, where our corpus, after filtering, achieved an alpha score of 0.692, higher than a recommendation of 0.667. For human recognition accuracy, our corpus scored up to 0.772 post-filtering. We also provide the results of the model trained on the corpus evaluated on both in-corpus and cross-corpus setups. The corpus is publicly available under a Creative Commons BY-SA 4.0, as well as our codes for the experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。