arXiv:2508.06042cs.AI2025-08被引 6

用分层多智能体架构提升游戏策略推理能力

Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning

  • 分层设计:专家示范训练专用智能体,生成结构化行动序列
  • 实测表现超越现有方法,在策略清晰度与适应性上均领先
  • 适合研究战略决策、多智能体协作及强化学习应用者

大型语言模型在动作序列预测方面表现出色,但在动态、长周期任务如《星际争霸2》(StarCraftII, SC2)中常因资源约束和环境部分可观测性而失效。为此,我们提出一种分层多智能体框架HIMA,由元控制器‘战略规划器’(SP)协调多个基于模仿学习的专用智能体。每个智能体通过专家示范学习特定策略,如空中支援或防御操作,生成连贯的多步行动序列。SP将这些提案整合为单一、环境自适应的长期计划,确保局部决策与整体战略一致。我们还构建了TEXTSCII-ALL,一个涵盖SC2所有种族对局组合的完整测试平台。实验表明,HIMA在策略清晰度、适应性和计算效率上均优于当前最优方法,验证了专用模仿模块与高层协调结合的有效性,为构建更鲁棒、通用的AI代理提供了新路径。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have recently demonstrated impressive action sequence prediction capabilities but often struggle with dynamic, long-horizon tasks such as real-time strategic games. In a game such as StarCraftII (SC2), agents need to manage resource constraints and adapt to evolving battlefield situations in a partially observable environment. This often overwhelms exisiting LLM-based approaches. To address these challenges, we propose a hierarchical multi-agent framework that employs specialized imitation learning agents under a meta-controller called Strategic Planner (SP). By expert demonstrations, each specialized agent learns a distinctive strategy, such as aerial support or defensive maneuvers, and produces coherent, structured multistep action sequences. The SP then orchestrates these proposals into a single, environmentally adaptive plan that ensures local decisions aligning with long-term strategies. We call this HIMA (Hierarchical Imitation Multi-Agent). We also present TEXTSCII-ALL, a comprehensive SC2 testbed that encompasses all race match combinations in SC2. Our empirical results show that HIMA outperforms state of the arts in strategic clarity, adaptability, and computational efficiency, underscoring the potential of combining specialized imitation modules with meta-level orchestration to develop more robust, general-purpose AI agents.

多智能体策略推理模仿学习星际争霸

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。