arXiv:2506.16718cs.MAcs.AI2025-06被引 1

让智能体在未知队友对手中灵活协作竞争,提升泛化能力。

Generalizable Agent Modeling for Agent Collaboration-Competition Adaptation with Multi-Retrieval and Dynamic Generation

  • 用行为轨迹建模队友与对手,动态生成适应策略。
  • 在SMAC、Overcooked-AI等场景中超越现有基线表现。
  • 适合需要跨团队协同的复杂多智能体系统研究者。

将单一智能体适配至新多智能体系统面临挑战,需应对任务、环境及未知队友与对手的交互变化。现有研究聚焦于零样本学习和临时组队两种简化场景,本文提出更全面的智能体协作-竞争泛化框架(ACCA),评估智能体在多样化场景、任务及与陌生队友和对手互动中的泛化能力。在ACCA中,智能体需适应任务与环境变化,与未见过的队友协作,对抗未知对手。为此,我们提出多检索与动态生成(MRDG)建模方法,通过行为轨迹建模队友与对手,并引入位置编码处理不同团队规模,采用超网络模块增强学习与适应能力,同时设计视角对齐模块统一检索到的队友与对手观察视角。在SMAC、Overcooked-AI和Melting Pot等基准场景的大量测试表明,MRDG显著提升了与未知队友和对手的鲁棒协作与竞争性能,优于现有基线。代码已开源:https://github.com/vcis-wangchenxu/MRDG.git

原文摘要 · Abstract (English)

Adapting a single agent to a new multi-agent system brings challenges, necessitating adjustments across various tasks, environments, and interactions with unknown teammates and opponents. Addressing this challenge is highly complex, and researchers have proposed two simplified scenarios, Multi-agent reinforcement learning for zero-shot learning and Ad-Hoc Teamwork. Building on these foundations, we propose a more comprehensive setting, Agent Collaborative-Competitive Adaptation (ACCA), which evaluates an agent to generalize across diverse scenarios, tasks, and interactions with both unfamiliar opponents and teammates. In ACCA, agents adjust to task and environmental changes, collaborate with unseen teammates, and compete against unknown opponents. We introduce a new modeling approach, Multi-Retrieval and Dynamic Generation (MRDG), that effectively models both teammates and opponents using their behavioral trajectories. This method incorporates a positional encoder for varying team sizes and a hypernetwork module to boost agents' learning and adaptive capabilities. Additionally, a viewpoint alignment module harmonizes the observational perspectives of retrieved teammates and opponents with the learning agent. Extensive tests in benchmark scenarios like SMAC, Overcooked-AI, and Melting Pot show that MRDG significantly improves robust collaboration and competition with unseen teammates and opponents, surpassing established baselines. Our code is available at: https://github.com/vcis-wangchenxu/MRDG.git

多智能体协作竞争泛化能力动态生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。