arXiv:2509.20338eess.SYcs.AI2025-09

让智能体自主决定何时行动和通信,节省算力与带宽。

Adaptive Event-Triggered Policy Gradient for Multi-Agent Reinforcement Learning

  • 联合学习控制策略与触发机制,动态决定行动时机。
  • 在多个基准上性能接近传统方法,计算量与通信量大幅降低。
  • 适合需要高效协同的多智能体系统,如机器人集群。

传统多智能体强化学习方法依赖定时触发执行,即智能体在固定时间间隔采样并通信,导致计算成本高、通信密集。为此,我们提出ET-MAPG(事件触发多智能体策略梯度强化学习)框架,联合学习智能体的控制策略与事件触发策略。与以往解耦机制不同,ET-MAPG将两者整合为统一学习过程,使智能体不仅学会采取何种动作,还学会何时执行。针对需要智能体间通信的场景,我们引入AET-MAPG,一种基于自注意力机制的变体,可学习选择性通信模式。AET-MAPG使智能体能自主决定何时触发动作、与谁通信及交换哪些信息,从而优化协作。两种方法均可与任意策略梯度类MARL算法结合。大量实验表明,在多种MARL基准测试中,本方法性能接近最先进的定时触发基线,同时显著降低计算负载与通信开销。

原文摘要 · Abstract (English)

Conventional multi-agent reinforcement learning (MARL) methods rely on time-triggered execution, where agents sample and communicate actions at fixed intervals. This approach is often computationally expensive and communication-intensive. To address this limitation, we propose ET-MAPG (Event-Triggered Multi-Agent Policy Gradient reinforcement learning), a framework that jointly learns an agent's control policy and its event-triggering policy. Unlike prior work that decouples these mechanisms, ET-MAPG integrates them into a unified learning process, enabling agents to learn not only what action to take but also when to execute it. For scenarios with inter-agent communication, we introduce AET-MAPG, an attention-based variant that leverages a self-attention mechanism to learn selective communication patterns. AET-MAPG empowers agents to determine not only when to trigger an action but also with whom to communicate and what information to exchange, thereby optimizing coordination. Both methods can be integrated with any policy gradient MARL algorithm. Extensive experiments across diverse MARL benchmarks demonstrate that our approaches achieve performance comparable to state-of-the-art, time-triggered baselines while significantly reducing both computational load and communication overhead.

多智能体强化学习事件触发通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。