用融合嵌入与混合损失提升阿拉伯语情绪分类效果
Improving Arabic Multi-Label Emotion Classification using Stacked Embeddings and Hybrid Loss Function
- 三模型嵌入堆叠+元学习生成增强表征
- 混合损失有效缓解标签不平衡与相关性问题
- 适合低资源语言情绪分析研究者参考
在阿拉伯语等低资源语言的多标签情绪分类中,类别不平衡和标签相关性严重制约模型性能,尤其影响少数情绪类别的识别。本文提出一种新方法,结合堆叠嵌入、元学习与混合损失函数,提升阿拉伯语多标签情绪分类表现。从三个微调的语言模型(ArabicBERT、MarBERT、AraBERT)提取上下文嵌入并堆叠形成丰富表征,经元学习训练后输入双层双向LSTM,再通过全连接网络完成分类。引入混合损失函数,整合类别加权、标签相关矩阵与对比学习,有效缓解类别不平衡并改善标签相关性处理。大量实验验证了该模型在精确率、召回率、F1值、杰卡德准确率和汉明损失等指标上的优越表现。细粒度分析显示,混合损失显著缩小了多数类与少数类之间的性能差距,实现更均衡的情绪分类。消融实验表明各组件均有贡献,整体优于基线模型及其他损失函数。本研究不仅推进阿拉伯语情绪分类,更提供可迁移至其他语言与领域的通用框架。
原文摘要 · Abstract (English)
In multi-label emotion classification, particularly for low-resource languages like Arabic, the challenges of class imbalance and label correlation hinder model performance, especially in accurately predicting minority emotions. To address these issues, this study proposes a novel approach that combines stacked embeddings, meta-learning, and a hybrid loss function to enhance multi-label emotion classification for the Arabic language. The study extracts contextual embeddings from three fine-tuned language models-ArabicBERT, MarBERT, and AraBERT-which are then stacked to form enriched embeddings. A meta-learner is trained on these stacked embeddings, and the resulting concatenated representations are provided as input to a Bi-LSTM model, followed by a fully connected neural network for multi-label classification. To further improve performance, a hybrid loss function is introduced, incorporating class weighting, label correlation matrix, and contrastive learning, effectively addressing class imbalances and improving the handling of label correlations. Extensive experiments validate the proposed model's performance across key metrics such as Precision, Recall, F1-Score, Jaccard Accuracy, and Hamming Loss. The class-wise performance analysis demonstrates the hybrid loss function's ability to significantly reduce disparities between majority and minority classes, resulting in a more balanced emotion classification. An ablation study highlights the contribution of each component, showing the superiority of the model compared to baseline approaches and other loss functions. This study not only advances multi-label emotion classification for Arabic but also presents a generalizable framework that can be adapted to other languages and domains, providing a significant step forward in addressing the challenges of low-resource emotion classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。