用博弈论工作流提升大模型在谈判中的理性决策能力
Game-theoretic LLM: Agent Workflow for Negotiation Games
- 设计博弈论流程引导大模型推理,增强理性决策
- 采用流程后大模型在谈判中更接近最优策略,减少被剥削风险
- 研究发现使用流程本身也是博弈策略,适合复杂交互场景
本文研究大语言模型(LLMs)在博弈论框架下的战略决策理性。我们在多种完全信息与不完全信息博弈中评估多个先进LLMs,发现随着博弈复杂度上升(如收益矩阵变大或序贯树加深),模型常偏离理性策略。为此,我们设计了多种博弈论工作流,指导模型推理与决策,以提升其计算纳什均衡和不确定环境下理性选择的能力。实验表明,采用工作流显著提升了模型在博弈任务中的理性与鲁棒性:模型更准确识别最优策略,在谈判场景中实现近最优分配,并降低被利用风险。此外,我们还探讨了代理是否应采用此类工作流的元策略问题——选择使用或放弃工作流本身构成一个博弈论议题。本研究深化了对大模型战略决策能力的理解,为构建更具战略理性的智能体提供了结构化方法。代码与数据见https://github.com/Wenyueh/game_theory。
原文摘要 · Abstract (English)
This paper investigates the rationality of large language models (LLMs) in strategic decision-making contexts, specifically within the framework of game theory. We evaluate several state-of-the-art LLMs across a spectrum of complete-information and incomplete-information games. Our findings reveal that LLMs frequently deviate from rational strategies, particularly as the complexity of the game increases with larger payoff matrices or deeper sequential trees. To address these limitations, we design multiple game-theoretic workflows that guide the reasoning and decision-making processes of LLMs. These workflows aim to enhance the models' ability to compute Nash Equilibria and make rational choices, even under conditions of uncertainty and incomplete information. Experimental results demonstrate that the adoption of these workflows significantly improves the rationality and robustness of LLMs in game-theoretic tasks. Specifically, with the workflow, LLMs exhibit marked improvements in identifying optimal strategies, achieving near-optimal allocations in negotiation scenarios, and reducing susceptibility to exploitation during negotiations. Furthermore, we explore the meta-strategic considerations of whether it is rational for agents to adopt such workflows, recognizing that the decision to use or forgo the workflow constitutes a game-theoretic issue in itself. Our research contributes to a deeper understanding of LLMs' decision-making capabilities in strategic contexts and provides insights into enhancing their rationality through structured workflows. The findings have implications for the development of more robust and strategically sound AI agents capable of navigating complex interactive environments. Code and data supporting this study are available at \url{https://github.com/Wenyueh/game_theory}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。