用语法与语义图交叉注意力提升低资源语言情感分析效果
CrosGrpsABS: Cross-Attention over Syntactic and Semantic Graphs for Aspect-Based Sentiment Analysis in a Low-Resource Language
- 通过双向交叉注意力融合句法结构与语义上下文
- 在孟加拉语数据集上实现最高F1提升0.93%
- 适合低资源语言情感分析研究者参考
基于方面的情感分析(ABSA)是自然语言处理中的基础任务,可提供文本中观点的细粒度洞察。现有研究主要集中在英语等资源丰富语言,依赖大规模标注数据、预训练模型和语言特定工具,但这些资源对孟加拉语等低资源语言难以获取。孟加拉语的ABSA因独特语言特征和缺乏标注数据、预训练模型及优化超参数而进展缓慢。为此,本文提出CrosGrpsABS,一种新颖的混合框架,利用句法图与语义图之间的双向交叉注意力,增强方面级情感分类。该模型结合基于Transformer的上下文嵌入与图卷积网络,基于规则的句法依存解析和语义相似性计算构建。通过双向交叉注意力,有效融合局部句法结构与全局语义上下文,在低资源与高资源场景下均表现优异。我们在四个低资源孟加拉语ABSA数据集和高资源英语SemEval 2014 Task 4数据集上评估,结果表明CrosGrpsABS持续优于现有方法,尤其在餐厅领域和笔记本领域分别取得0.93%和1.06%的F1分数提升。
原文摘要 · Abstract (English)
Aspect-Based Sentiment Analysis (ABSA) is a fundamental task in natural language processing, offering fine-grained insights into opinions expressed in text. While existing research has largely focused on resource-rich languages like English which leveraging large annotated datasets, pre-trained models, and language-specific tools. These resources are often unavailable for low-resource languages such as Bengali. The ABSA task in Bengali remains poorly explored and is further complicated by its unique linguistic characteristics and a lack of annotated data, pre-trained models, and optimized hyperparameters. To address these challenges, this research propose CrosGrpsABS, a novel hybrid framework that leverages bidirectional cross-attention between syntactic and semantic graphs to enhance aspect-level sentiment classification. The CrosGrpsABS combines transformerbased contextual embeddings with graph convolutional networks, built upon rule-based syntactic dependency parsing and semantic similarity computations. By employing bidirectional crossattention, the model effectively fuses local syntactic structure with global semantic context, resulting in improved sentiment classification performance across both low- and high-resource settings. We evaluate CrosGrpsABS on four low-resource Bengali ABSA datasets and the high-resource English SemEval 2014 Task 4 dataset. The CrosGrpsABS consistently outperforms existing approaches, achieving notable improvements, including a 0.93% F1-score increase for the Restaurant domain and a 1.06% gain for the Laptop domain in the SemEval 2014 Task 4 benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。