用模拟器评测并训练大模型的情绪管理能力,提升多轮互动中的情感响应效果。
EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management

- 构建模拟用户行为的交互式情绪管理评测框架,支持多轮反馈。
- 15个模型在边界维护任务中表现不佳,表明当前模型存在短板。
- 提出新强化学习方法,显著提升模型在情绪管理上的综合表现。
大型语言模型(LLM)的情绪智能常通过静态理解任务或单轮对话评估,但情绪管理本质是交互性的:优秀模型不仅需识别用户情绪,还应在多轮互动中改善其情绪与关系状态。本文提出EIBench,一个基于模拟器的交互式情绪管理基准,包含2,222个场景(2,009用于训练,213用于测试),按支持、防御、修复、魅力四类组织,覆盖不同支持形式、边界维护、信任修复与亲密度建立。每个场景中,LLM模拟器扮演用户,每轮更新情绪-关系状态,并以锚定评分方式映射最终状态。该设计使EIBench兼具评估与训练功能:最终状态提供奖励信号,每轮状态更新提供密集反馈用于强化学习。我们评估了15个开源与闭源模型,发现当前模型在支持与亲密度建立任务中表现良好,但在用户施压下的边界维护任务中表现薄弱。为此,提出中心化转信用GRPO(CTC-GRPO),利用模拟器的逐轮状态更新作为密集的回合级反馈,同时保留最终结果奖励。CTC-GRPO将Qwen3-8B在EIBench上的得分从-22.4提升至+22.4,并在分布外评估中显著提升:SAGE上+12.4,EQBench3上+20.9%。结果表明,模拟器追踪的用户状态可有效支撑多轮情绪管理的评估与训练。
原文摘要 · Abstract (English)
Emotional intelligence (EI) in Large Language Models (LLMs) is often evaluated through static understanding tasks or single-response dialogue generation. However, emotion management is interactive: a good model should not only recognize a user's emotion, but also improve the user's emotional and relational state over several turns. We introduce EIBench, a simulator-based benchmark for interactive emotion management. EIBench contains 2,222 scenarios, with 2,009 for training and 213 for held-out testing. The scenarios are organized by a 2x2 taxonomy covering Support, Defense, Repair, and Charm, which together capture different forms of support, boundary maintenance, trust repair, and rapport building. In each scenario, an LLM simulator plays the user, updates an emotion-relation state after each turn, and maps the final state to an anchor-based score. This design makes EIBench both an evaluation benchmark and a training environment: the final state gives the outcome reward, while the per-turn state updates provide dense feedback for RL. We evaluate 15 open- and closed-source LLMs. Current models perform well on support and rapport-building scenes, but struggle with boundary maintenance under user pressure. To improve the EI ability of LLMs, we propose Centered Turn-Credit GRPO (CTC-GRPO), a GRPO extension that reuses the simulator's per-turn state updates as dense turn-level feedback while preserving the final outcome reward. CTC-GRPO improves Qwen3-8B from -22.4 to +22.4 on EIBench and also improves on out-of-distribution evaluations including SAGE (+12.4) and EQBench3 (+20.9%). Our results show that simulator-tracked user states can support both evaluation and training for multi-turn emotion management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。