arXiv:2601.12886cs.MAcs.AI2026-01被引 1

梳理多智能体强化学习中的通信方法,揭示其适用场景与局限。

Communication Methods in Multi-Agent Reinforcement Learning

  • 分析5类通信机制:显式、隐式、注意力、图结构、分层角色
  • 指出无通用最优方案,需依任务特性选择通信方式
  • 强调低计算开销通信对大规模系统可扩展性的关键作用

多智能体强化学习是将传统强化学习拓展至多智能体系统的有前景研究方向。近年来,大量通信方法被引入以应对部分可观测环境、非平稳性及动作空间指数级增长等问题。通信还能促进智能体间的高效协作。本文通过对该领域29篇文献的深入分析,评估了显式、隐式、基于注意力、基于图结构以及分层/角色型通信方法的优劣。结果表明,不存在适用于所有问题的通用最优通信框架,通信方式的选择高度依赖具体任务。对比还凸显了低计算开销通信方法的重要性,以实现多智能体系统在大规模交互环境中的可扩展性。最后,论文讨论了当前研究空白,强调亟需建立系统级指标的标准化基准,并提升在真实通信条件下的鲁棒性,以增强这些方法在现实场景中的应用能力。

原文摘要 · Abstract (English)

Multi-agent reinforcement learning is a promising research area that extends established reinforcement learning approaches to problems formulated as multi-agent systems. Recently, a multitude of communication methods have been introduced to this field to address problems such as partially observable environments, non-stationarity, and exponentially growing action spaces. Communication further enables efficient cooperation among all agents interacting in an environment. This work aims at providing an overview of communication techniques in multi-agent reinforcement learning. By an in-depth analysis of 29 publications on this topic, the strengths and weaknesses of explicit, implicit, attention-based, graph-based, and hierarchical/role-based communication are evaluated. The results of this comparison show that there is no general, optimal communication framework for every problem. On the contrary, the choice of communication depends heavily on the problem at hand. The comparison also highlights the importance of communication methods with low computational overhead to enable scalability to environments where many agents interact. Finally, the paper discusses current research gaps, emphasizing the need for standardized benchmarking of system-level metrics and improved robustness under realistic communication conditions to enhance the real-world applicability of these approaches.

多智能体强化学习通信机制可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。