arXiv:2501.17598cs.CLcs.LG2025-01被引 6

用大模型增强无标签数据,提升情感分析精度。

Semantic Consistency Regularization with Large Language Models for Semi-supervised Sentiment Analysis

  • 利用大模型对无标签文本进行实体或概念级语义重构。
  • 通过置信度阈值筛选高质量一致样本,增强训练监督信号。
  • 适合资源有限但需高精度情感分析的场景。

准确的情感分析对理解客户反馈、监测市场趋势和公共情绪检测至关重要,但人工标注大规模语料成本高昂。为此,本文提出基于大语言模型的语义一致性正则化框架(SCR),用于半监督情感分析。通过两种提示策略增强无标签文本:基于实体的增强(SCR-EE)提取关键信息并由大模型重建;基于概念的增强(SCR-CE)直接对原句进行语义重构。随后,将大模型生成的数据用于一致性损失,并结合置信度阈值筛选高质量一致样本,提供额外监督信号。此外,借鉴类别空间收缩定理,设计类别重组装策略以充分利用不确定样本。实验表明,该方法在多个基准上显著优于现有半监督方法。

原文摘要 · Abstract (English)

Accurate sentiment analysis of texts is crucial for a variety of applications, such as understanding customer feedback, monitoring market trends, and detecting public sentiment. However, manually annotating large sentiment corpora for supervised learning is labor-intensive and time-consuming. Therefore, it is essential and effective to develop a semi-supervised method for the sentiment analysis task. Although some methods have been proposed for semi-supervised text classification, they rely on the intrinsic information within the unlabeled data and the learning capability of the NLP model, which lack generalization ability to the sentiment analysis scenario and may prone to overfit. Inspired by the ability of pretrained Large Language Models (LLMs) in following instructions and generating coherent text, we propose a Semantic Consistency Regularization with Large Language Models (SCR) framework for semi-supervised sentiment analysis. We introduce two prompting strategies to semantically enhance unlabeled text using LLMs. The first is Entity-based Enhancement (SCR-EE), which involves extracting entities and numerical information, and querying the LLM to reconstruct the textual information. The second is Concept-based Enhancement (SCR-CE), which directly queries the LLM with the original sentence for semantic reconstruction. Subsequently, the LLM-augmented data is utilized for a consistency loss with confidence thresholding, which preserves high-quality agreement samples to provide additional supervision signals during training. Furthermore, to fully utilize the uncertain unlabeled data samples, we propose a class re-assembling strategy inspired by the class space shrinking theorem. Experiments show our method achieves remarkable performance over prior semi-supervised methods.

情感分析大模型半监督提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。