构建越南语细粒度情感数据集,提升社交媒体情绪识别准确率
ViGoEmotions: A Benchmark Dataset For Fine-grained Emotion Detection on Vietnamese Texts
- 构建20,664条带27类情感标签的越南语社交媒体文本数据集
- 转换表情符号为文字可提升BERT类模型性能,保留原表情符号对ViSoBERT最优
- ViSoBERT达61.50%宏平均F1,适合多场景越南语情感分析研究
情绪分类在情绪预测和有害内容检测中具有重要意义。近年来,自然语言处理技术尤其是大语言模型的发展显著提升了该领域的表现。本文提出ViGoEmotions——一个包含20,664条越南语社交媒体评论的细粒度情感语料库,每条评论标注27种具体情绪类别。为评估数据集质量及其对情绪分类的影响,采用三种预处理策略(保留原始表情符号并进行规则归一化、将表情符号转为文本描述、使用基于模型的ViSoLex词法归一化系统)测试了八种预训练Transformer模型。结果表明,将表情符号转为文本能提升多个BERT基线模型性能,而保留表情符号对ViSoBERT和CafeBERT表现最佳;删除表情符号则普遍导致性能下降。ViSoBERT取得最高宏平均F1分数61.50%与加权F1分数63.26%。CafeBERT和PhoBERT也表现出较强性能。研究显示,尽管该语料库可支持多种模型架构,但预处理策略与标注质量仍是影响下游任务表现的关键因素。
原文摘要 · Abstract (English)
Emotion classification plays a significant role in emotion prediction and harmful content detection. Recent advancements in NLP, particularly through large language models (LLMs), have greatly improved outcomes in this field. This study introduces ViGoEmotions -- a Vietnamese emotion corpus comprising 20,664 social media comments in which each comment is classified into 27 fine-grained distinct emotions. To evaluate the quality of the dataset and its impact on emotion classification, eight pre-trained Transformer-based models were evaluated under three preprocessing strategies: preserving original emojis with rule-based normalization, converting emojis into textual descriptions, and applying ViSoLex, a model-based lexical normalization system. Results show that converting emojis into text often improves the performance of several BERT-based baselines, while preserving emojis yields the best results for ViSoBERT and CafeBERT. In contrast, removing emojis generally leads to lower performance. ViSoBERT achieved the highest Macro F1-score of 61.50% and Weighted F1-score of 63.26%. Strong performance was also observed from CafeBERT and PhoBERT. These findings highlight that while the proposed corpus can support diverse architectures effectively, preprocessing strategies and annotation quality remain key factors influencing downstream performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。