用大模型和位置信息提升旅游情感分析的四元组抽取效果
Enhancing Aspect-based Sentiment Analysis in Tourism Using Large Language Models and Positional Information
- 结合大模型生成辅助知识,再通过位置信息建模实现四元组抽取
- 在自建旅游数据集上F1提升7.49%,优于现有模型
- 适合需要精准分析旅游评价的行业应用者
旅游领域的方面级情感分析(ABSA)对理解游客对景点特定方面的评价至关重要,有助于推动旅游业创新与发展。然而,传统流水线模型存在误差传播和情感要素提取不完整等问题。为此,本文提出一种面向方面-类别-观点-情感四元组抽取(ACOSQE)的方面级情感分析模型ACOS_LLM。该模型包含两个关键阶段:辅助知识生成与ACOSQE任务执行。首先,使用Adalora微调大语言模型生成高质量辅助知识;为提升效率,采用SparseGPT将微调后模型压缩至50%稀疏度。随后,结合位置信息与序列建模,以辅助知识和原文作为输入完成四元组抽取。在自建旅游数据集及公开数据集Rest15、Rest16上进行实验,结果表明该模型表现优异,在旅游数据集上相比其他模型F1提升7.49%;在Rest15和Rest16数据集上分别提升0.05%和1.06%。
原文摘要 · Abstract (English)
Aspect-Based Sentiment Analysis (ABSA) in tourism plays a significant role in understanding tourists' evaluations of specific aspects of attractions, which is crucial for driving innovation and development in the tourism industry. However, traditional pipeline models are afflicted by issues such as error propagation and incomplete extraction of sentiment elements. To alleviate this issue, this paper proposes an aspect-based sentiment analysis model, ACOS_LLM, for Aspect-Category-Opinion-Sentiment Quadruple Extraction (ACOSQE). The model comprises two key stages: auxiliary knowledge generation and ACOSQE. Firstly, Adalora is used to fine-tune large language models for generating high-quality auxiliary knowledge. To enhance model efficiency, Sparsegpt is utilized to compress the fine-tuned model to 50% sparsity. Subsequently, Positional information and sequence modeling are employed to achieve the ACOSQE task, with auxiliary knowledge and the original text as inputs. Experiments are conducted on both self-created tourism datasets and publicly available datasets, Rest15 and Rest16. Results demonstrate the model's superior performance, with an F1 improvement of 7.49% compared to other models on the tourism dataset. Additionally, there is an F1 improvement of 0.05% and 1.06% on the Rest15 and Rest16 datasets, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。