用认知评估理论提升隐式情感分析,通过多任务学习增强推理能力。
Task-Routed Mixture-of-Experts with Cognitive Appraisal for Implicit Sentiment Analysis

- 基于认知评估理论设计多任务框架,引入情感检测与理由生成辅助任务。
- 采用任务路由的专家混合模型,减少不同任务间的干扰,提升性能。
- 在隐式情感子集上显著优于现有方法,适合需要深层推理的场景。
隐式情感分析因情感需从事件中推断而非直接表达而困难。现有模型仅依赖最终极性标签,难以指导上下文推理。受认知评估理论启发,我们提出一种感知评估的多任务学习框架,通过隐式情感检测和认知理由生成两个互补辅助任务提供极性预测支持。为减少多目标训练中的任务干扰,采用任务级专家混合模型,各任务共享一组专家,由任务身份控制稀疏组合。模型基于编码器-解码器架构,替换部分编码器和解码器块为稀疏混合结构,使用任务条件路由器选择专家组合,并采用任务分离的路由目标促使不同任务学习不同的专家选择模式。实验表明,该模型在隐式情感子集上优于近期方法,取得显著提升。代码已公开于https://github.com/yaping166/TRMoE-ISA。
原文摘要 · Abstract (English)
Implicit sentiment analysis is challenging because sentiment toward an aspect is often inferred from events rather than expressed through explicit opinion words. Existing models typically learn from the final polarity label, which provides limited guidance for reasoning about sentiment from the context. Motivated by cognitive appraisal theory, we propose an appraisal-aware multi-task learning (MTL) framework for implicit sentiment analysis that provides polarity prediction with two complementary auxiliary tasks: implicit sentiment detection and cognitive rationale generation. However, training several objectives with different targets and sharing a single backbone across tasks in MTL limits flexibility and can lead to task interference. To reduce interference among these related but distinct objectives, we adopt task-level mixture-of-experts models in which all tasks share a common set of experts, and task identity controls the sparse combination of these experts. Our method builds on an encoder-decoder architecture and replaces a subset of encoder and decoder blocks with these sparse mixtures. We use a task-conditioned router to select sparse expert mixtures for each task, and a task-separated routing objective to encourage different tasks to learn distinct expert-selection patterns. Experimental results show that our model outperforms recently proposed approaches, with strong gains on the implicit sentiment subset. Our code is available at https://github.com/yaping166/TRMoE-ISA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。