arXiv:2505.24255cs.CLcs.AI2025-05

用心理理论提升大模型在谈判中的符合人类行为的表现

Effects of Theory of Mind and Prosocial Beliefs on Steering Human-Aligned Behaviors of LLMs in Ultimatum Games

  • 给大模型设定不同利他信念并引入多层级心理理论推理
  • 2700次模拟显示心理理论显著提升行为与人类一致性和决策稳定
  • 适合研究人机协作、社会性智能的学者和开发者参考

大型语言模型(LLMs)在模拟人类行为和进行心理理论(ToM)推理方面展现出潜力,这对复杂社交互动至关重要。本文以最后通牒游戏为任务,探究心理理论推理在使代理行为与人类规范对齐中的作用。我们为不同大模型代理设置不同利他信念(贪婪、公平、无私)和推理方式(思维链与多级心理理论推理),考察其在多个模型(包括o3-mini和DeepSeek-R1 Distilled Qwen 32B)上的决策过程与结果。共进行2,700次模拟,结果显示,心理理论推理能显著提升行为与人类的一致性、决策一致性及谈判结果。尽管推理型模型表现有限,但心理理论增强后的模型在不同角色中表现出更优性能。公平提案者与接受提议的响应者最符合其策略推理,而所有代理在拒绝提议时均高度符合人类信念,除非提议本身公平。人工验证发现,Llama 3.3 70B产生的推理最符合其行为与信念。本研究深化了对心理理论在人机交互与合作决策中作用的理解。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown potential in simulating human behaviors and performing theory-of-mind (ToM) reasoning, crucial for complex social interactions. We investigate ToM reasoning's role in aligning agentic behaviors with human norms in negotiation tasks, using the ultimatum game as our referenced task. We initialized LLM agents with different prosocial beliefs (Greedy, Fair, Selfless) and reasoning methods (chain of thought and ToM reasoning of varying levels), examining their decision-making process and outcome across multiple LLMs, including reasoning models like o3-mini and DeepSeek-R1 Distilled Qwen 32B. We perform 2,700 simulations to show that ToM reasoning enhances behavioral alignment with human, decision-making consistency, and negotiation outcomes. Consistent with prior findings, reasoning LLMs exhibit limited capability compared to ToM-enhanced LLMs, with different game roles benefiting from different ToM orders. Fair proposers and responders accepting offers were the most consistent with their strategic reasonings, whereas all agents showed strong consistencies with human beliefs when rejecting offers, except when the offer was fair. Human verification further revealed that Llama 3.3 70B produces reasoning most consistent with its actions and beliefs. Our findings advance understanding of ToM's role in human-AI interaction and cooperative decision-making. The code used for our experiments can be found at https://github.com/Stealth-py/UltimatumToM.

心理理论大模型人机协作博弈论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。