arXiv:2503.17821cs.AI2025-03ICLR被引 16

改进游戏环境,让AI在陌生协作中表现更真实可靠。

OvercookedV2: Rethinking Overcooked for Zero-Shot Coordination

  • 用状态增强让训练覆盖更多未知搭档情况
  • 独立训练的AI在新环境中实现成功协作
  • 适合研究零样本协作与在线适应算法的人

AI代理有望通过协助人类达成目标而改变日常生活。要实现这一目标,代理必须能在无先前互动的情况下与新伙伴协作,即零样本协作(ZSC)。Overcooked已成为评估AI代理协调能力的主流基准。本文探究了Overcooked中ZSC挑战的根源,提出一种状态增强机制,将可能遇到的未知搭档状态纳入训练分布,缓解了分布外问题。实验表明,在该方法下独立训练的代理可在Overcooked中成功协作。结果表明,ZSC失败主要源于自对弈训练中状态覆盖不足,而非复杂的协调难题。因此,原版Overcooked不适合作为ZSC基准。为此,我们提出OvercookedV2,引入非对称信息和随机性,构建更具挑战性的ZSC场景。实验验证,仅靠全面状态覆盖不足以实现良好协作。我们利用OvercookedV2设计了一系列新挑战,包括需测试时形成协议的任务,并证明现有算法无法应对,亟需可在线适应的新协调算法。我们希望OvercookedV2能推动下一代ZSC算法发展,促进人机协作进步。

原文摘要 · Abstract (English)

AI agents hold the potential to transform everyday life by helping humans achieve their goals. To do this successfully, agents need to be able to coordinate with novel partners without prior interaction, a setting known as zero-shot coordination (ZSC). Overcooked has become one of the most popular benchmarks for evaluating coordination capabilities of AI agents and learning algorithms. In this work, we investigate the origins of ZSC challenges in Overcooked. We introduce a state augmentation mechanism which mixes states that might be encountered when paired with unknown partners into the training distribution, reducing the out-of-distribution challenge associated with ZSC. We show that independently trained agents under this algorithm coordinate successfully in Overcooked. Our results suggest that ZSC failure can largely be attributed to poor state coverage under self-play rather than more sophisticated coordination challenges. The Overcooked environment is therefore not suitable as a ZSC benchmark. To address these shortcomings, we introduce OvercookedV2, a new version of the benchmark, which includes asymmetric information and stochasticity, facilitating the creation of interesting ZSC scenarios. To validate OvercookedV2, we conduct experiments demonstrating that mere exhaustive state coverage is insufficient to coordinate well. Finally, we use OvercookedV2 to build a new range of coordination challenges, including ones that require test time protocol formation, and we demonstrate the need for new coordination algorithms that can adapt online. We hope that OvercookedV2 will help benchmark the next generation of ZSC algorithms and advance collaboration between AI agents and humans.

零样本协作多智能体游戏基准在线适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。