arXiv:2510.25224cs.CL2025-10被引 2

首个评估多方谈判中主动智能代理的框架,提升协作效率与共识达成。

ProMediate: A Socio-cognitive framework for evaluating proactive agents in multi-party negotiation

  • 基于社会认知理论构建可插拔的主动调解代理
  • 在高难度场景下共识提升3.6个百分点,响应速度加快77%
  • 适合研究多智能体协作与人机协同的学者和开发者

尽管大语言模型日益用于单用户辅助,但亟需能主动管理复杂多方协作的智能体。现有系统性评估方法匮乏,制约了支持多人协同的AI发展。谈判是检验该挑战的理想场景,需具备社会认知智能以应对多方利益冲突与多议题协商。本文提出ProMediate,首个用于评估复杂、多议题、多方谈判中主动智能调解代理的框架。其包含两个核心部分:(i) 基于真实谈判案例与理论驱动难度等级(ProMediate-Easy、Medium、Hard)的仿真测试平台,支持可插拔的主动调解代理,依据社会认知调解理论灵活决定介入时机与方式;(ii) 一套新的社会认知评估体系,包含共识变化、干预延迟、调解有效性与智能度等指标。结果表明,具备社会智能的调解代理相比通用基线表现更优:在ProMediate-Hard场景中,共识提升3.6个百分点(10.65% vs 7.01%),响应速度提高77%(15.98s vs 3.71s)。ProMediate为推动主动、社会智能代理的发展提供了严谨、理论支撑的评估体系。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) are increasingly used in agentic frameworks to assist individual users, there is a growing need for agents that can proactively manage complex, multi-party collaboration. Systematic evaluation methods for such proactive agents remain scarce, limiting progress in developing AI that can effectively support multiple people together. Negotiation offers a demanding testbed for this challenge, requiring socio-cognitive intelligence to navigate conflicting interests between multiple participants and multiple topics and build consensus. Here, we present ProMediate, the first framework for evaluating proactive AI mediator agents in complex, multi-topic, multi-party negotiations. ProMediate consists of two core components: (i) a simulation testbed based on realistic negotiation cases and theory-driven difficulty levels (ProMediate-Easy, ProMediate-Medium, and ProMediate-Hard), with a plug-and-play proactive AI mediator grounded in socio-cognitive mediation theories, capable of flexibly deciding when and how to intervene; and (ii) a socio-cognitive evaluation framework with a new suite of metrics to measure consensus changes, intervention latency, mediator effectiveness, and intelligence. Together, these components establish a systematic framework for assessing the socio-cognitive intelligence of proactive AI agents in multi-party settings. Our results show that a socially intelligent mediator agent outperforms a generic baseline, via faster, better-targeted interventions. In the ProMediate-Hard setting, our social mediator increases consensus change by 3.6 percentage points compared to the generic baseline (10.65\% vs 7.01\%) while being 77\% faster in response (15.98s vs. 3.71s). In conclusion, ProMediate provides a rigorous, theory-grounded testbed to advance the development of proactive, socially intelligent agents.

多智能体谈判模拟社会智能主动代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。