用大模型和博弈论分析语言谈判中的动态联盟,精准预测谁会守约。
Dynamic Coalition Structure Detection in Natural Language-based Interactions
- 分两阶段:先提取对话中双方的协议,再评估协议对各方的战略价值。
- 在真实Diplomacy游戏中,高分协议多被遵守,低分则常被违背。
- 适合研究语言协商、智能体联盟与博弈行为分析的学者。
在战略多智能体序贯交互中,识别动态联盟结构对于理解自利智能体如何协作影响结果至关重要。然而,基于自然语言的交互因意图模糊和难以建模玩家主观视角而带来独特挑战。本文提出一种新方法,利用大语言模型与博弈论进展,预测《外交》(Diplomacy)这一需通过自然语言谈判组建多边联盟的战略多智能体游戏中联盟的形成。该方法分为两阶段:第一阶段结合基于解析的过滤函数与微调的语言模型,从双人私密对话中提取讨论过的协议集合;第二阶段引入超博弈理论中的主观可理性化概念,定义新度量来评估每项协议对玩家的预期价值,通过评估协议对双方的战略价值,并考虑一方对另一方是否会履约的主观信念。实验表明,该方法能有效识别在线《外交》游戏中的潜在联盟结构,对可能被遵守的协议赋予高分,对可能被违反的协议赋予低分。该方法为语言协商环境中的联盟形成提供了基础洞见,并指明了未来复杂自然语言交互分析的研究方向。
原文摘要 · Abstract (English)
In strategic multi-agent sequential interactions, detecting dynamic coalition structures is crucial for understanding how self-interested agents coordinate to influence outcomes. However, natural-language-based interactions introduce unique challenges to coalition detection due to ambiguity over intents and difficulty in modeling players' subjective perspectives. We propose a new method that leverages recent advancements in large language models and game theory to predict dynamic multilateral coalition formation in Diplomacy, a strategic multi-agent game where agents negotiate coalitions using natural language. The method consists of two stages. The first stage extracts the set of agreements discussed by two agents in their private dialogue, by combining a parsing-based filtering function with a fine-tuned language model trained to predict player intents. In the second stage, we define a new metric using the concept of subjective rationalizability from hypergame theory to evaluate the expected value of an agreement for each player. We then compute this metric for each agreement identified in the first stage by assessing the strategic value of the agreement for both players and taking into account the subjective belief of one player that the second player would honor the agreement. We demonstrate that our method effectively detects potential coalition structures in online Diplomacy gameplay by assigning high values to agreements likely to be honored and low values to those likely to be violated. The proposed method provides foundational insights into coalition formation in multi-agent environments with language-based negotiation and offers key directions for future research on the analysis of complex natural language-based interactions between agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。