用插件式语法知识增强大模型,提升情感分析精度。
Large Language Models Enhanced by Plug and Play Syntactic Knowledge for Aspect-based Sentiment Analysis
- 插入独立训练的语法记忆模块,动态注入句法信息
- 在多个基准数据集上超越现有方法,性能显著提升
- 无需微调大模型,适合资源受限场景使用
方面级情感分析(ABSA)需要深入理解上下文信息,包括方面词及其句法依赖关系。现有方法多依赖预训练大语言模型(LLM)捕捉上下文,但训练成本高且数据不足时难以微调。为此,本文提出一种即插即用的增强方法,通过可扩展组件整合成分句法、依存关系和组合类型语法(CCG)等多种句法知识。具体地,设计一个独立训练的语法记忆模块,记录并注入句法信息以指导情感极性预测,该模块可作为通用插件与不同LLM对接。在多个基准数据集上的实验表明,该方法优于强基线和已有方法,验证了其有效性。
原文摘要 · Abstract (English)
Aspect-based sentiment analysis (ABSA) generally requires a deep understanding of the contextual information, including the words associated with the aspect terms and their syntactic dependencies. Most existing studies employ advanced encoders (e.g., pre-trained models) to capture such context, especially large language models (LLMs). However, training these encoders is resource-intensive, and in many cases, the available data is insufficient for necessary fine-tuning. Therefore it is challenging for learning LLMs within such restricted environments and computation efficiency requirement. As a result, it motivates the exploration of plug-and-play methods that adapt LLMs to ABSA with minimal effort. In this paper, we propose an approach that integrates extendable components capable of incorporating various types of syntactic knowledge, such as constituent syntax, word dependencies, and combinatory categorial grammar (CCG). Specifically, we propose a memory module that records syntactic information and is incorporated into LLMs to instruct the prediction of sentiment polarities. Importantly, this encoder acts as a versatile, detachable plugin that is trained independently of the LLM. We conduct experiments on benchmark datasets, which show that our approach outperforms strong baselines and previous approaches, thus demonstrates its effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。