设计激励机制提升多智能体系统在危机下的协作韧性
Learning Incentive Structures for Cooperative Resilience in Multi-Agent Systems under Social Dilemmas
- 通过可学习的激励结构引导智能体行为
- 混合激励使系统崩溃减少57%,性能更稳定
- 适合研究群体协作与抗干扰的学者
多智能体社会困境(如公地悲剧)中,个体利益与集体福祉冲突,系统易因扰动而崩溃。本文研究协作韧性——即系统在扰动下通过自适应行为维持集体福祉的能力。提出一种学习激励结构的框架,在多智能体强化学习中,通过奖励函数引导个体决策与集体行为。利用韧性评分对智能体轨迹进行打分排序,反推促进韧性行为的奖励函数,并将其融入学习过程。在受扰动的资源共享环境中评估三种激励结构:个体激励、韧性对齐激励、以及结合两者的混合激励。结果表明,混合激励能有效维持集体行为,将资源耗尽导致的崩溃事件减少57%,并在扰动下保持系统性能。研究揭示了激励设计在促进系统韧性中的关键作用,提供了一种应对多智能体社会困境的计算框架。
原文摘要 · Abstract (English)
Multi-agent social dilemmas, such as the tragedy of the commons, capture settings where individual incentives conflict with collective well-being, making these systems highly vulnerable to collapse under disruptions. In this context, this work studies cooperative resilience, understood as the system-level ability to maintain collective well-being under perturbations through adaptive agent behavior. We propose a framework for learning incentive structures aligned with collective well-being in multi-agent reinforcement learning systems, where reward functions shape individual decision-making and collective behavior. A resilience metric is used to score and rank agent trajectories, allowing the inference of reward functions that promote resilient collective behavior. These inferred reward functions are integrated into the multi-agent reinforcement learning process to shape agent interactions in social dilemma settings. The approach is evaluated in resource-sharing environments subject to disruptions, using three incentive structures: individual incentives, resilience-aligned incentives, and a hybrid incentive structure that combines both individual and collective components. The results show that the hybrid incentive structure promotes sustained collective behavior, reduces collapse events associated with resource depletion, and preserves system performance under disruption. These findings highlight the role of incentive design as a mechanism for promoting resilient collective behavior and provide a computational framework for multi-agent social dilemmas under disruptions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。