arXiv:2601.06780cs.CLcs.AI2026-01被引 3

用进化合并与课程学习提升多任务情感分析模型性能。

Multi-Stage Evolutionary Model Merging with Meta Data Driven Curriculum Learning for Sentiment-Specialized Large Language Modeling

  • 分阶段进化合并专家模型,融合多任务情感数据。
  • 在多个子任务上超越传统大模型,提升准确率。
  • 适合需要高精度多任务情感分析的研究与应用。

大型语言模型(LLM)的兴起显著推动了自然语言处理的发展,使通用模型能在少量训练下完成多种任务。然而,传统情感分析方法局限于单一任务如情感分类或基于方面分析,在需处理多任务的实际场景中不实用。尽管LLM具备灵活性,但在特定情感任务上仍难达到所需精度。微调与进化模型合并技术可将模型整合为统一框架,提升学习性能并降低计算成本。当前,利用任务元数据和课程学习优化学习过程的研究仍较匮乏。本研究提出一种混合学习模型——多阶段进化模型合并结合元数据驱动的课程学习(MEM-MCL),以增强大模型在情感分析中的表现。具体而言,通过指令微调构建特定情感任务的专家模型,再使用进化算法合并成统一模型,并借助弱数据优化合并过程。同时引入课程学习机制,依据任务难度提供学习序列,提升从LLM中提取知识的能力。实验结果表明,所提MEM-MCL模型在多数情感分析任务中优于传统LLM,各项子任务表现均更优。

原文摘要 · Abstract (English)

The emergence of large language models (LLMs) has significantly transformed natural language processing (NLP), enabling more generalized models to perform various tasks with minimal training. However, traditional sentiment analysis methods, which focus on individual tasks such as sentiment classification or aspect-based analysis, are not practical for real-world applications that usually require handling multiple tasks. While offering flexibility, LLMs in sentiment-specific tasks often fall short of the required accuracy. Techniques like fine-tuning and evolutionary model merging help integrate models into a unified framework, which can improve the learning performance while reducing computational costs. The use of task meta-data and curriculum learning to optimize learning processes remains underexplored, while sentiment analysis is a critical task in NLP that requires high accuracy and scalability across multiple subtasks. In this study, we propose a hybrid learning model called Multi-stage Evolutionary Model Merging with Meta data driven Curriculum Learning (MEM-MCL), to enhance the sentiment analysis in large language modeling. In particular, expert models are created through instruction tuning for specific sentiment tasks and then merged using evolutionary algorithms to form a unified model. The merging process is optimized with weak data to enhance performance across tasks. The curriculum learning is incorporated to provide a learning sequence based on task difficulty, improving knowledge extraction from LLMs. Experiment results demonstrate that the proposed MEM-MCL model outperforms conventional LLMs in a majority of sentiment analysis tasks, achieving superior results across various subtasks.

情感分析模型合并课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。