综述多智能体协作决策的场景、方法与挑战,聚焦强化学习和大模型新范式。
A Comprehensive Survey on Multi-Agent Cooperative Decision-Making: Scenarios, Approaches, Challenges and Perspectives
- 按任务形式、奖励机制等梳理主流仿真平台,分类分析技术路径。
- 重点对比MARL与大模型驱动方法在协作效率与适应性上的优势。
- 适合关注智能体协同系统设计的研究者与应用开发者参考。
随着人工智能快速发展,智能决策技术已在人机对抗中超越人类水平,尤其在复杂的多智能体协作任务中表现突出。多智能体协作决策涉及多个智能体协同完成既定任务并达成目标,广泛应用于自动驾驶、无人机导航、灾害救援及模拟军事对抗等真实场景。本文首先全面综述多智能体协作决策的主流仿真环境与平台,从任务格式、奖励分配及底层技术等多个维度进行深入分析。随后系统介绍当前主流的智能决策方法、算法与模型,主要分为五类:基于规则(以模糊逻辑为主)、基于博弈论、基于进化算法、基于深度多智能体强化学习(MARL)以及基于大语言模型(LLMs)推理的方法。鉴于MARL与基于LLMs的方法相较传统方法具有显著优势,本文重点探讨这两类技术,详述其方法论分类、优势与局限。最后,展望未来关键研究方向及多智能体协作决策面临的核心挑战。
原文摘要 · Abstract (English)
With the rapid development of artificial intelligence, intelligent decision-making techniques have gradually surpassed human levels in various human-machine competitions, especially in complex multi-agent cooperative task scenarios. Multi-agent cooperative decision-making involves multiple agents working together to complete established tasks and achieve specific objectives. These techniques are widely applicable in real-world scenarios such as autonomous driving, drone navigation, disaster rescue, and simulated military confrontations. This paper begins with a comprehensive survey of the leading simulation environments and platforms used for multi-agent cooperative decision-making. Specifically, we provide an in-depth analysis for these simulation environments from various perspectives, including task formats, reward allocation, and the underlying technologies employed. Subsequently, we provide a comprehensive overview of the mainstream intelligent decision-making approaches, algorithms and models for multi-agent systems (MAS). Theseapproaches can be broadly categorized into five types: rule-based (primarily fuzzy logic), game theory-based, evolutionary algorithms-based, deep multi-agent reinforcement learning (MARL)-based, and large language models(LLMs)reasoning-based. Given the significant advantages of MARL andLLMs-baseddecision-making methods over the traditional rule, game theory, and evolutionary algorithms, this paper focuses on these multi-agent methods utilizing MARL and LLMs-based techniques. We provide an in-depth discussion of these approaches, highlighting their methodology taxonomies, advantages, and drawbacks. Further, several prominent research directions in the future and potential challenges of multi-agent cooperative decision-making are also detailed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。