用混合神经网络提升情感分析准确率,尤其改善负面情绪识别
Opinion Mining and Analysis Using Hybrid Deep Neural Networks
- 结合BGRU与LSTM构建混合模型,更好捕捉语境信息
- 在IMDB和亚马逊数据集上达到95%测试准确率,负向情感召回率达96%
- 有效缓解数据不平衡问题,降低误分类损失至13.3%
随着社交媒体和电子商务的发展,理解用户态度已成为决策的关键。文本意见是最具结构化的信息,在情感分析中扮演重要角色。现有方法如词典法和传统机器学习难以应对上下文细微差别和可扩展性问题。深度学习虽有所改进,尤其在利用RNN和CNN捕捉语义关系方面,但仍存在性能与泛化能力不足的局限。本研究提出一种融合双向门控循环单元(BGRU)与长短期记忆(LSTM)的混合深度神经网络模型(HBGRU-LSTM),旨在提升情感分析效果,解决上下文模糊、可扩展性及类别不平衡等挑战。通过在标准数据集IMDB电影评论和Amazon产品评价上进行实验验证,该模型测试准确率达到95%,优于LSTM(93.06%)、CNN+LSTM(93.31%)和GRU+LSTM(92.20%)。同时,负向情感召回率从不平衡数据集的86%提升至平衡数据集的96%,误分类损失由20.24%降至13.3%,表明模型具备更强的泛化能力与鲁棒性。
原文摘要 · Abstract (English)
Understanding customer attitudes has become a critical component of decision-making due to the growing influence of social media and e-commerce. Text-based opinions are the most structured, hence playing an important role in sentiment analysis. Most of the existing methods, which include lexicon-based approaches and traditional machine learning techniques, are insufficient for handling contextual nuances and scalability. While the latter has limitations in model performance and generalization, deep learning (DL) has achieved improvement, especially on semantic relationship capturing with recurrent neural networks (RNNs) and convolutional neural networks (CNNs). The aim of the study is to enhance opinion mining by introducing a hybrid deep neural network model that combines a bidirectional gated recurrent unit (BGRU) and long short-term memory (LSTM) layers to improve sentiment analysis, particularly addressing challenges such as contextual nuance, scalability, and class imbalance. To substantiate the efficacy of the proposed model, we conducted comprehensive experiments utilizing benchmark datasets, encompassing IMDB movie critiques and Amazon product evaluations. The introduced hybrid BGRULSTM (HBGRU-LSTM) architecture attained a testing accuracy of 95%, exceeding the performance of traditional DL frameworks such as LSTM (93.06%), CNN+LSTM (93.31%), and GRU+LSTM (92.20%). Moreover, our model exhibited a noteworthy enhancement in recall for negative sentiments, escalating from 86% (unbalanced dataset) to 96% (balanced dataset), thereby ensuring a more equitable and just sentiment classification. Furthermore, the model diminished misclassification loss from 20.24% for unbalanced to 13.3% for balanced dataset, signifying enhanced generalization and resilience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。