通过多视角注意力增强句法信息,提升细粒度情感分析效果
Multi-View Attention Syntactic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis
- 构建依赖树多个子图视图,用注意力机制区分不同句法信息
- 在四个基准数据集上达到当前最佳性能,准确率提升1.2%-2.3%
- 适合需要精细情感分析的场景,如产品评论与用户反馈处理
面向方面的情感分析(ABSA)旨在预测句子中方面词的情感极性。近年来,利用图神经网络(GNNs)捕捉依存句法分析生成的依存树中的句法结构信息,已被证明是提升ABSA性能的有效方法。然而,多数现有工作仅使用依存树的单一拓扑视图,或简单融合不同视角信息而未加区分,限制了模型表现。为此,本文提出一种多视角注意力句法增强图卷积网络(MASGCN),通过注意力机制对不同句法信息视图进行加权。具体地,从依存树构建距离掩码矩阵以获取多个子图视图;设计多视角注意力机制计算各视图的权重;进一步将依存类型信息矩阵融合至邻接矩阵,并引入结构熵损失来学习依存类型邻接矩阵。在四个基准数据集上的全面实验表明,该模型优于现有最先进方法。代码与数据集见:https://github.com/SELGroup/MASGCN。
原文摘要 · Abstract (English)
Aspect-based Sentiment Analysis (ABSA) is the task aimed at predicting the sentiment polarity of aspect words within sentences. Recently, incorporating graph neural networks (GNNs) to capture additional syntactic structure information in the dependency tree derived from syntactic dependency parsing has been proven to be an effective paradigm for boosting ABSA. Despite GNNs enhancing model capability by fusing more types of information, most works only utilize a single topology view of the dependency tree or simply conflate different perspectives of information without distinction, which limits the model performance. To address these challenges, in this paper, we propose a new multi-view attention syntactic enhanced graph convolutional network (MASGCN) that weighs different syntactic information of views using attention mechanisms. Specifically, we first construct distance mask matrices from the dependency tree to obtain multiple subgraph views for GNNs. To aggregate features from different views, we propose a multi-view attention mechanism to calculate the attention weights of views. Furthermore, to incorporate more syntactic information, we fuse the dependency type information matrix into the adjacency matrices and present a structural entropy loss to learn the dependency type adjacency matrix. Comprehensive experiments on four benchmark datasets demonstrate that our model outperforms state-of-the-art methods. The codes and datasets are available at https://github.com/SELGroup/MASGCN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。