arXiv:2602.15407cs.LG2026-02被引 1

针对不对称社会困境,提出更公平的协作机制。

Fairness over Equality: Correcting Social Incentives in Asymmetric Sequential Social Dilemmas

  • 按个体奖励范围重新定义公平性,避免强制均等化
  • 引入基于代理的加权机制,适应先天差异
  • 本地化社会反馈,无需全局信息共享

顺序社会困境(SSDs)是研究个体激励与集体福利冲突下合作如何产生的关键框架。在多智能体强化学习中,现有方法通常通过内在驱动力促进亲社会或公平行为,但普遍假设智能体具有相同激励,并依赖全局信息评估公平性。本文引入经典的SSD环境的不对称变体,考察智能体间天然差异对合作动态的影响。结果表明,现有基于公平性的方法在不对称条件下因强制追求绝对平等而错误激励背叛。为此,我们提出三项改进:(i) 根据智能体的奖励范围重新定义公平性;(ii) 引入基于代理的加权机制以更好处理固有不对称性;(iii) 局部化社会反馈,使方法在部分可观测环境下有效,无需全局信息共享。实验显示,在不对称场景中,本方法比现有方法更快促成合作策略,且不牺牲可扩展性与实用性。

原文摘要 · Abstract (English)

Sequential Social Dilemmas (SSDs) provide a key framework for studying how cooperation emerges when individual incentives conflict with collective welfare. In Multi-Agent Reinforcement Learning, these problems are often addressed by incorporating intrinsic drives that encourage prosocial or fair behavior. However, most existing methods assume that agents face identical incentives in the dilemma and require continuous access to global information about other agents to assess fairness. In this work, we introduce asymmetric variants of well-known SSD environments and examine how natural differences between agents influence cooperation dynamics. Our findings reveal that existing fairness-based methods struggle to adapt under asymmetric conditions by enforcing raw equality that wrongfully incentivize defection. To address this, we propose three modifications: (i) redefining fairness by accounting for agents' reward ranges, (ii) introducing an agent-based weighting mechanism to better handle inherent asymmetries, and (iii) localizing social feedback to make the methods effective under partial observability without requiring global information sharing. Experimental results show that in asymmetric scenarios, our method fosters faster emergence of cooperative policies compared to existing approaches, without sacrificing scalability or practicality.

多智能体公平性合作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。