arXiv:2604.11840cs.LGcs.AI2026-04被引 1

大模型在多方谈判模拟中,看似多样实则缺乏真实行为保真度。

Diversity Without Fidelity: A Solver-Sampler Mismatch in Multi-Agent LLM Negotiation Simulation

  • 用多智能体谈判测试模型的采样能力,而非求解最优策略。
  • 开启推理后模型表现多样但依然无法达成协议,15轮中15次失败。
  • 自动生成谈判笔记能促成交,说明记忆机制对真实行为至关重要。

语言模型越来越多地被用于模拟人类行为,如调查受访者、谈判者或政策讨论中的利益相关方。在此角色中,模型应复现人类的真实行为模式:犹豫、迟疑让步、接受非完美协议,而非追求最优解。我们称此为‘采样者’角色,与追求最优解的‘求解者’角色相对。本文测试主流厂商提供的推理模式如何影响模型作为采样者的性能。实验场景为五方在15轮内协商一项法规,未解决事项由权威裁决。无结构记忆的智能体几乎从不达成协议:314/315次运行最终由权威决定。开启推理仅改变失败形式——某模型家族虽表现出多样化动作、多数运行中有让步且路径各异,但仍于15轮内全部失败。若仅以结果多样性检验,该模型可能通过,但实际缺乏真实行为保真度。另两个发现表明协议是可行的:当智能体自主撰写简短谈判笔记时,协议成为常态;而预先提供相同笔记则无效果。此外,遵循教科书让步策略的手写代理在相同规则下多数达成协议。因此,模拟管道应独立评估模型作为采样者的性能,因为求解能力不能反映采样保真度,开启推理也无法提升它。

原文摘要 · Abstract (English)

Language models are increasingly used to simulate people: survey respondents, negotiators, stakeholders in policy exercises. In that role a model should reproduce how people plausibly behave, hesitating, conceding late, and settling for imperfect deals, rather than playing the best move. We call this the sampler role, in contrast to the solver role of finding the best move, and we test how the reasoning modes providers ship to strengthen models as solvers affect it. Our testbed is multi-party negotiation: five agents bargain over a regulation for fifteen turns, and unresolved issues are decided by an authority. Agents without a structured memory of the negotiation almost never reach agreement, whether reasoning is on or off: 314 of 315 such runs end with the authority deciding. What reasoning changes is how the failure looks. With reasoning enabled, one model family negotiates visibly, with varied moves, concessions in most runs, and a different path every time, yet still ends without agreement in fifteen runs of fifteen. Diversity checks would pass a model whose endings never change. Two further results show the task permits agreement: when agents write their own short running notes on the negotiation, agreement becomes the norm, while the same notes supplied ready-made change nothing; and hand-coded agents following textbook concession strategies agree in most runs under identical rules. Simulation pipelines should therefore vet models as samplers, on the distributions of outcomes they produce. Fidelity as a sampler must be tested on its own: solver strength is no guide to it, and switching on reasoning leaves it where it was.

多智能体谈判模拟行为保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。