arXiv:2511.08832cs.LGcs.AI2025-11被引 4

用动态图建模智能体间随时间变化的协作关系,提升多智能体强化学习性能。

TIGER-MARL: Enhancing Multi-Agent Reinforcement Learning with Temporal Information through Graph-based Embeddings and Representations

  • 构建时序动态图,融合当前与历史交互关系
  • 在两个基准任务上超越基线模型,提升任务表现与采样效率
  • 适合研究多智能体协同与动态关系建模的学者

本文提出一种基于图嵌入与表示的时序信息建模方法TIGER,用于增强多智能体强化学习(MARL)。传统MARL方法依赖静态或每步的关联图,忽略了智能体在适应、移动或重组合作策略过程中自然产生的交互演化。为此,TIGER构建了反映智能体当前与历史交互的动态时序图,并采用基于时序注意力的编码器,在结构与时间邻域中聚合信息,生成具有时间感知能力的智能体嵌入,以指导合作策略学习。在两个高协作需求的基准任务上,TIGER持续优于多种值分解与图结构的MARL基线模型,在任务性能和样本效率方面均有显著提升。通过全面消融实验,验证了结构与时间因素对策略学习的协同影响。代码已公开于https://github.com/Nikunj-Gupta/tiger-marl。

原文摘要 · Abstract (English)

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent coordination structures evolve over time. While most MARL approaches rely on static or per-step relational graphs, they overlook the temporal evolution of interactions that naturally arise as agents adapt, move, or reorganize cooperation strategies. Capturing such evolving dependencies is key to achieving robust and adaptive coordination. To this end, TIGER constructs dynamic temporal graphs of MARL agents, connecting their current and historical interactions. It then employs a temporal attention-based encoder to aggregate information across these structural and temporal neighborhoods, yielding time-aware agent embeddings that guide cooperative policy learning. Through extensive experiments on two coordination-intensive benchmarks, we show that TIGER consistently outperforms diverse value-decomposition and graph-based MARL baselines in task performance and sample efficiency. Furthermore, we conduct comprehensive ablation studies to isolate the impact of key design parameters in TIGER, revealing how structural and temporal factors can jointly shape effective policy learning in MARL. All codes can be found here: https://github.com/Nikunj-Gupta/tiger-marl.

多智能体时序建模图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。