用大模型生成目标语言伪标签,无需翻译工具提升跨语言情感分析效果
LACA: Improving Cross-lingual Aspect-Based Sentiment Analysis with LLM Data Augmentation
- 用大模型根据原始文本生成更自然的替代句子来修正噪声预测
- 在六种语言上超越已有最先进方法,提升幅度达1.8~4.2个点
- 适合做多语言情感分析且资源有限的研究者使用
跨语言方面级情感分析(ABSA)通过从有标注数据的源语言迁移知识,实现对目标语言的细粒度情感分析。现有方法高度依赖常不准确的翻译工具来弥合语言差距。本文提出一种新方法,利用大语言模型(LLM)在无需翻译工具的情况下,为目标语言生成高质量伪标签数据。首先训练ABSA模型对未标注的目标语言数据进行预测;接着,通过提示工程让LLM生成更能反映这些噪声预测的自然句子;最后,在生成的伪标签数据集上进一步微调ABSA模型。该方法在六种语言和五种主干模型上验证有效,性能超越以往基于翻译的最先进方法。框架还支持生成式模型,实验表明微调后的LLM优于小型多语言模型。
原文摘要 · Abstract (English)
Cross-lingual aspect-based sentiment analysis (ABSA) involves detailed sentiment analysis in a target language by transferring knowledge from a source language with available annotated data. Most existing methods depend heavily on often unreliable translation tools to bridge the language gap. In this paper, we propose a new approach that leverages a large language model (LLM) to generate high-quality pseudo-labelled data in the target language without the need for translation tools. First, the framework trains an ABSA model to obtain predictions for unlabelled target language data. Next, LLM is prompted to generate natural sentences that better represent these noisy predictions than the original text. The ABSA model is then further fine-tuned on the resulting pseudo-labelled dataset. We demonstrate the effectiveness of this method across six languages and five backbone models, surpassing previous state-of-the-art translation-based approaches. The proposed framework also supports generative models, and we show that fine-tuned LLMs outperform smaller multilingual models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。