用博弈论方法让自利的大模型智能体公平协作并合理分配贡献
Shapley-Coop: Credit Assignment for Emergent Cooperation in Self-Interested LLM Agents
- 基于边际贡献设计任务定价机制,引导智能体理性协作
- 在多智能体游戏和软件工程模拟中提升协作效率与公平性
- 适合研究人机协同、激励机制或大模型自治系统的设计者
大型语言模型在预设角色和流程的多智能体系统中表现优异,但在缺乏协调规则的开放环境中,智能体常呈现自利行为。实现协作的核心挑战在于信用分配——公平评估每个智能体的贡献,并设计能对齐异构目标的定价机制。随着大模型日益参与复杂的人机协同,公平补偿与责任追溯依赖有效的定价机制。受人类社会临时合作(如雇佣或分包)启发,我们提出协作流程 Shapley-Coop:结合基于边际贡献的 Shapley Chain-of-Thought 与结构化协商协议,实现理性任务时间定价与事后奖励再分配。该方法对齐智能体激励,促进合作且保持自主性。我们在两个多智能体游戏和一个软件工程仿真中验证了 Shapley-Coop,结果表明其持续提升智能体协作能力,并实现公平的信用分配,证明其定价机制能准确反映执行过程中的个体贡献。
原文摘要 · Abstract (English)
Large Language Models (LLMs) show strong collaborative performance in multi-agent systems with predefined roles and workflows. However, in open-ended environments lacking coordination rules, agents tend to act in self-interested ways. The central challenge in achieving coordination lies in credit assignment -- fairly evaluating each agent's contribution and designing pricing mechanisms that align their heterogeneous goals. This problem is critical as LLMs increasingly participate in complex human-AI collaborations, where fair compensation and accountability rely on effective pricing mechanisms. Inspired by how human societies address similar coordination challenges (e.g., through temporary collaborations such as employment or subcontracting), we propose a cooperative workflow, Shapley-Coop. Shapley-Coop integrates Shapley Chain-of-Thought -- leveraging marginal contributions as a principled basis for pricing -- with structured negotiation protocols for effective price matching, enabling LLM agents to coordinate through rational task-time pricing and post-task reward redistribution. This approach aligns agent incentives, fosters cooperation, and maintains autonomy. We evaluate Shapley-Coop across two multi-agent games and a software engineering simulation, demonstrating that it consistently enhances LLM agent collaboration and facilitates equitable credit assignment. These results highlight the effectiveness of Shapley-Coop's pricing mechanisms in accurately reflecting individual contributions during task execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。