arXiv:2509.04310cs.AI2025-09被引 8

让AI在讨价还价中学会动态情绪策略,更难被欺骗。

EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiation

  • 用进化强化学习优化谈判中的情绪表达策略
  • 在多轮谈判中提升成功率与买家节省金额
  • 适合研究智能体博弈与情感计算的学者

大型语言模型(LLM)的思维链(CoT)推理研究已证明智能体可进行复杂、多轮谈判,为代理型AI开辟新路径。然而,现有LLM智能体普遍忽视情绪在谈判中的功能作用,仅生成被动、偏好驱动的情绪响应,易被对手操纵和策略利用。为此,我们提出EvoEmo,一种基于进化强化学习的框架,用于优化谈判中动态情绪表达。EvoEmo将情绪状态转换建模为马尔可夫决策过程,并采用基于种群的遗传优化,在多种谈判场景中演化高回报情绪策略。我们进一步设计评估框架,包含基线方法:通用策略与固定情绪策略,用于基准测试情绪感知谈判能力。大量实验与消融研究显示,EvoEmo持续优于两类基线,在成功率、效率及买家节省方面均有提升。结果表明,自适应情绪表达对构建高效LLM谈判智能体至关重要。代码已公开于https://github.com/Yunbo-max/EvoEmo。

原文摘要 · Abstract (English)

Recent research on Chain-of-Thought (CoT) reasoning in Large Language Models (LLMs) has demonstrated that agents can engage in \textit{complex}, \textit{multi-turn} negotiations, opening new avenues for agentic AI. However, existing LLM agents largely overlook the functional role of emotions in such negotiations, instead generating passive, preference-driven emotional responses that make them vulnerable to manipulation and strategic exploitation by adversarial counterparts. To address this gap, we present EvoEmo, an evolutionary reinforcement learning framework that optimizes dynamic emotional expression in negotiations. EvoEmo models emotional state transitions as a Markov Decision Process and employs population-based genetic optimization to evolve high-reward emotion policies across diverse negotiation scenarios. We further propose an evaluation framework with two baselines -- vanilla strategies and fixed-emotion strategies -- for benchmarking emotion-aware negotiation. Extensive experiments and ablation studies show that EvoEmo consistently outperforms both baselines, achieving higher success rates, higher efficiency, and increased buyer savings. This findings highlight the importance of adaptive emotional expression in enabling more effective LLM agents for multi-turn negotiation. The code is available at \href{https://github.com/Yunbo-max/EvoEmo}{\textcolor{red}{https://github.com/Yunbo-max/EvoEmo}}.

谈判智能体情绪建模强化学习LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。