用进化算法加速星际争霸大地图策略学习,效率提升近一倍
NeuroPAL: Punctuated Anytime Learning with Neuroevolution for Macromanagement in Starcraft: Brood War
- 结合突变式即时学习与拓扑进化,分阶段训练提高效率
- 在固定地图上仅用一半时间达到人类高手水平策略表现
- 自动生成专家级战术如兵营布局和防守优化,适合复杂策略研究
星际争霸:母巢之战仍是人工智能研究中的挑战性基准,尤其在需要长期战略规划的宏观管理领域。传统方法依赖规则系统或监督深度学习,存在适应性差和计算效率低的问题。本文提出NeuroPAL,一种融合神经演化架构(NEAT)与突变式即时学习(PAL)的神经进化框架,通过频繁低保真训练与周期性高保真评估交替进行,显著提升NEAT的样本效率。我们在星际争霸:母巢之战的固定地图单种族场景中评估NeuroPAL,结果表明其使学习过程加速约50%,在约一半训练时间内即达到具备竞争力的对战水平。此外,演化出的智能体展现出代理兵营布置、防御建筑优化等涌现行为,这些是人类高手常用策略。研究显示,类似PAL的结构化评估机制能有效提升神经进化在复杂实时策略环境中的可扩展性与有效性。
原文摘要 · Abstract (English)
StarCraft: Brood War remains a challenging benchmark for artificial intelligence research, particularly in the domain of macromanagement, where long-term strategic planning is required. Traditional approaches to StarCraft AI rely on rule-based systems or supervised deep learning, both of which face limitations in adaptability and computational efficiency. In this work, we introduce NeuroPAL, a neuroevolutionary framework that integrates Neuroevolution of Augmenting Topologies (NEAT) with Punctuated Anytime Learning (PAL) to improve the efficiency of evolutionary training. By alternating between frequent, low-fidelity training and periodic, high-fidelity evaluations, PAL enhances the sample efficiency of NEAT, enabling agents to discover effective strategies in fewer training iterations. We evaluate NeuroPAL in a fixed-map, single-race scenario in StarCraft: Brood War and compare its performance to standard NEAT-based training. Our results show that PAL significantly accelerates the learning process, allowing the agent to reach competitive levels of play in approximately half the training time required by NEAT alone. Additionally, the evolved agents exhibit emergent behaviors such as proxy barracks placement and defensive building optimization, strategies commonly used by expert human players. These findings suggest that structured evaluation mechanisms like PAL can enhance the scalability and effectiveness of neuroevolution in complex real-time strategy environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。