用大模型自动学习任务权重,提升隐含情感分析效果
Multi-Task Learning with LLMs for Implicit Sentiment Analysis: Data-level and Task-level Automatic Weight Learning
- 通过生成辅助任务补充情感信息,动态调整数据与任务权重
- 不同规模模型在多任务中实现最优平衡,显著提升识别准确率
- 适合需要高精度情感分析的NLP研究者和工业应用
隐含情感分析(ISA)因缺乏明显情感词而面临挑战。以往方法受限于数据不足和推理能力有限。本文提出MT-ISA框架,结合大语言模型(LLM)的生成与推理能力,通过自动多任务学习增强ISA。该框架利用生成式LLM构建辅助任务以补充情感元素,并引入数据级与任务级自动权重学习(AWL),动态识别可靠数据与关键任务,使不同规模模型能基于自身推理能力自适应调整权重。研究比较了三种数据级AWL策略,同时采用同方差不确定性处理任务级不确定性。大量实验表明,各规模模型在主任务与辅助任务间达到最佳平衡,验证了方法的有效性与适应性。
原文摘要 · Abstract (English)
Implicit sentiment analysis (ISA) presents significant challenges due to the absence of salient cue words. Previous methods have struggled with insufficient data and limited reasoning capabilities to infer underlying opinions. Integrating multi-task learning (MTL) with large language models (LLMs) offers the potential to enable models of varying sizes to reliably perceive and recognize genuine opinions in ISA. However, existing MTL approaches are constrained by two sources of uncertainty: data-level uncertainty, arising from hallucination problems in LLM-generated contextual information, and task-level uncertainty, stemming from the varying capacities of models to process contextual information. To handle these uncertainties, we introduce MT-ISA, a novel MTL framework that enhances ISA by leveraging the generation and reasoning capabilities of LLMs through automatic MTL. Specifically, MT-ISA constructs auxiliary tasks using generative LLMs to supplement sentiment elements and incorporates automatic MTL to fully exploit auxiliary data. We introduce data-level and task-level automatic weight learning (AWL), which dynamically identifies relationships and prioritizes more reliable data and critical tasks, enabling models of varying sizes to adaptively learn fine-grained weights based on their reasoning capabilities. We investigate three strategies for data-level AWL, while also introducing homoscedastic uncertainty for task-level AWL. Extensive experiments reveal that models of varying sizes achieve an optimal balance between primary prediction and auxiliary tasks in MT-ISA. This underscores the effectiveness and adaptability of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。