用混合模型提升西语情感分类准确率,避免翻译损失
Emotion Classification In-Context in Spanish
- 结合TF-IDF与BERT嵌入,用集成学习保留原语言语义
- 在西语数据集上达93.3%准确率,优于单模型和翻译方案
- 适合关注西语客户反馈分析的企业与研究者
将西班牙语客户反馈分类为积极、中性、消极三类情感对理解情绪和改善客户体验至关重要。传统方法通过翻译至较少见语言进行处理,导致语义完整性和上下文细节丢失。为此,本文提出一种混合方法,结合TF-IDF与BERT嵌入,利用自定义堆叠集成(CSE)将西班牙语文本转化为富含语义的数值表示。评估采用逻辑回归、KNN、基于LGBM的袋装分类器和AdaBoost等模型,其中CSE以这些模型为基分类器,使用一对多逻辑回归作为元模型。实验结果显示,CSE在原生西语数据集上测试准确率达93.3%,高于翻译版本表现。结果表明,融合向量化技术与BERT可显著提升西语情感分类精度,为商业机构优化客户反馈分析提供有力支持。
原文摘要 · Abstract (English)
Classifying customer feedback into distinct emotion categories is essential for understanding sentiment and improving customer experience. In this paper, we classify customer feedback in Spanish into three emotion categories--positive, neutral, and negative--using advanced NLP and ML techniques. Traditional methods translate feedback from widely spoken languages to less common ones, resulting in a loss of semantic integrity and contextual nuances inherent to the original language. To address this limitation, we propose a hybrid approach that combines TF-IDF with BERT embeddings, effectively transforming Spanish text into rich numerical representations that preserve the semantic depth of the original language by using a Custom Stacking Ensemble (CSE) approach. To evaluate emotion classification, we utilize a range of models, including Logistic Regression, KNN, Bagging classifier with LGBM, and AdaBoost. The CSE model combines these classifiers as base models and uses a one-vs-all Logistic Regression as the meta-model. Our experimental results demonstrate that CSE significantly outperforms the individual and BERT model, achieving a test accuracy of 93.3% on the native Spanish dataset--higher than the accuracy obtained from the translated version. These findings underscore the challenges of emotion classification in Spanish and highlight the advantages of combining vectorization techniques like TF-IDF with BERT for improved accuracy. Our results provide valuable insights for businesses seeking to leverage emotion classification to enhance customer feedback analysis and service improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。