arXiv:2506.18651cs.AI2025-06

通过分组结构控制行为多样性,提升多智能体协作效率

Structured Diversity Control: A Dual-Level Framework for Group-Aware Multi-Agent Coordination

  • 将多样性分为组内凝聚力与组间专属性,动态调节协同策略
  • 在多目标追捕中平均奖励提升47.1%,复杂中和任务耗时减少12.82%
  • 无需修改奖励函数,适合需要精细分工的多智能体系统

在多智能体强化学习中,行为多样性控制是复杂协作场景下的关键挑战。现有方法虽尝试对所有智能体进行差异性调节,但缺乏对多智能体组合结构的深层刻画,导致在复杂任务中性能不佳或协作失败。为此,我们提出结构化多样性控制(SDC)框架,将全局多样性定义为组内多样性(最小化以增强凝聚力)与组间多样性(最大化以促进专业化)的加权组合,其权衡由预设的多样性结构因子(DSF)控制,实现细粒度的组感知策略调控。该方法直接约束策略架构,不改变奖励函数。结构化的多样性定义使SDC在多种实验中取得显著提升:在多目标追捕任务中平均奖励提高47.1%,在复杂中和场景中回合长度缩短12.82%。该方法为组感知多智能体系统的协作问题提供了新的分析视角。

原文摘要 · Abstract (English)

Controlling the behavioral diversity is a pivotal challenge in multi-agent reinforcement learning (MARL), particularly in complex collaborative scenarios. While existing methods attempt to regulate behavioral diversity by directly differentiating across all agents, they lack deep characterization and learning of multi-agent composition structures. This limitation leads to suboptimal performance or coordination failures when facing more complex or challenging tasks. To bridge this gap, we introduce Structured Diversity Control (SDC), a framework that redefines the system-wide diversity metric as a weighted combination of intra-group diversity, which is minimized for cohesion and inter-group diversity, which is maximized for specialization. The trade-off is governed by a pre-set Diversity Structure Factor (DSF), allowing for fine-grained, group-aware control over the collective strategy. Our method directly constrains the policy architecture without altering reward functions. This structural definition of diversity enables SDC to deliver substantial performance gains across various experiments, including increasing average rewards by up to 47.1\% in multi-target pursuit and reducing episode lengths by 12.82\% in complex neutralization scenarios. The proposed method offers a novel analytical perspective on the problem of cooperation in group-aware multi-agent systems.

多智能体协作优化多样性控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。