让大模型按任务难易自动调节推理长度,提升情感理解效果
Emotion-o1: Adaptive Long Reasoning for Emotion Understanding in LLMs
- 根据情感任务复杂度动态调整推理深度,避免过度或不足推理
- 在讽刺识别等任务上F1提升最高达27%,8B模型超越Grok-3和Claude-3.7
- 推理长度减少83%仍保持高准确率,适合高效情感分析场景
长链式思维(CoT)推理在提升大语言模型(LLMs)情感理解能力方面展现出巨大潜力。然而,现有固定长度的CoT方法难以平衡推理深度与效率:简单任务(如情感分类)过度推理,复杂任务(如讽刺理解)则缺乏深度。为此,我们提出Emotion-o1,一种基于情感任务复杂度动态调整推理长度的自适应CoT框架。该框架通过从一个面向推理的LLM中蒸馏自适应CoT模式,再经监督微调和四部分奖励机制的强化学习训练,分别优化准确性、简洁性、结构性和冗余度。在四个情感任务上的实验表明:(1) Emotion-o1相较基线模型显著提升性能,F1得分提升分别为10%(情感分类)、5%(情绪分类)、18%(幽默理解)和27%(讽刺理解);(2) 在情感分类与讽刺任务中,我们的8B模型优于Grok-3(+1.1%)和Claude-3.7(+2%);(3) 相比OpenAI-o1,推理长度减少83%的同时保持高准确率,实现精度与效率的高效优化。
原文摘要 · Abstract (English)
Long chain-of-thought (CoT) reasoning has shown great promise in enhancing the emotion understanding performance of large language models (LLMs). However, current fixed-length CoT methods struggle to balance reasoning depth and efficiency. Simple tasks (e.g., sentiment classification) are over-reasoned, while complex tasks (e.g., sarcasm understanding) lack depth. To fill this gap, we present Emotion-o1, an adaptive CoT framework that dynamically adjusts reasoning length based on emotion-task complexity. Emotion-o1 is trained by distilling adaptive CoT patterns from a reasoning-oriented LLM, followed by supervised fine-tuning and reinforcement learning with a four-part reward targeting accuracy, brevity, structure, and redundancy. Experimental results on four emotion tasks highlight: (1) Emotion-o1 demonstrates significant improvements over its backbone, with F1 score increases of 10%(Sentiment), 5%(Emotion), 18%(Humor), and 27%(Sarcasm). (2) In sentiment and sarcasm tasks, our 8B model demonstrates superior performance against advanced LLMs, outperforming Grok-3 by 1.1% and Claude-3.7 by 2%. (3) The framework maintains accuracy while reducing reasoning length by 83% compared to OpenAI-o1, demonstrating effective precision-efficiency optimization. Emotion-o1 effectively balances reasoning depth and efficiency for emotion understanding in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。