构建了百万级对战数据集,评估AI在宝可梦竞技赛中的策略泛化能力
VGC-Bench: Towards Mastering Diverse Team Strategies in Competitive Pokémon
- 设计多智能体基准测试框架,支持不同队伍配置下的策略训练与评估
- 单队训练模型在专业选手对抗中胜率超50%,但面对多样队伍时表现下降
- 揭示了泛化性与可被利用性的权衡,适合研究对抗性多智能体系统的研究者
开发能无需重训即适应多样战略环境的AI代理是多智能体学习的核心挑战。宝可梦视频游戏锦标赛(VGC)拥有约10^139种队伍组合,远超国际象棋、围棋、扑克、星际争霸或Dota等游戏。由于宝可梦组队具有高度组合性,最优策略强烈依赖于己方与对手队伍配置,使得泛化尤为困难。为此,我们提出VGC-Bench:一个包含关键基础设施、标准化评估协议的基准平台,提供超过70万条真人对战日志数据集,以及基于启发式规则、大语言模型、行为克隆、多智能体强化学习等方法的基线模型。在仅使用单一队伍配置的镜像对局中,我们的方法可击败专业选手。随着队伍数量增加,原先表现最佳的算法性能下降且更易被利用,但对未见队伍的泛化能力提升。代码与数据已开源。
原文摘要 · Abstract (English)
Developing AI agents that can robustly adapt to varying strategic landscapes without retraining is a central challenge in multi-agent learning. Pokémon Video Game Championships (VGC) is a domain with a vast space of approximately $10^{139}$ team configurations, far larger than those of other games such as Chess, Go, Poker, StarCraft, or Dota. The combinatorial nature of team building in Pokémon VGC causes optimal strategies to vary substantially depending on both the controlled team and the opponent's team, making generalization uniquely challenging. To advance research on this problem, we introduce VGC-Bench: a benchmark that provides critical infrastructure, standardizes evaluation protocols, and supplies a human-play dataset of over 700,000 battle logs and a range of baseline agents based on heuristics, large language models, behavior cloning, and multi-agent reinforcement learning with empirical game-theoretic methods such as self-play, fictitious play, and double oracle. In the restricted setting where an agent is trained and evaluated in a mirror match with a single team configuration, our methods can win against a professional VGC competitor. We repeat this training and evaluation with progressively larger team sets and find that as the number of teams increases, the best-performing algorithm in the single-team setting has worse performance and is more exploitable, but has improved generalization to unseen teams. Our code and dataset are open-sourced at https://github.com/cameronangliss/vgc-bench and https://huggingface.co/datasets/cameronangliss/vgc-battle-logs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。