arXiv:2511.10501cs.AI2025-11

融合图神经网络与强化学习,构建更真实的多智能体博弈模型。

Graph Neural Networks, Deep Reinforcement Learning and Probabilistic Topic Modeling for Strategic Multiagent Settings

  • 用图神经网络捕捉智能体间动态关系,建模复杂交互
  • 结合博弈论缓解现实场景中假设失效问题,提升可靠性
  • 适合研究复杂对抗系统或需动态适应的决策场景

本文综述了图神经网络(GNN)、深度强化学习(DRL)和概率主题模型(PTM)在战略多智能体设置中的应用潜力。重点关注两类问题:一是利用机器学习方法发现未知模型结构以支持对手建模;二是将这些方法与博弈论概念结合,避免依赖在真实场景中常不成立的共同先验假设(CPA)和自利假说(SIH)。分析了处理不确定性和异质性的能力,以及可扩展性。提出使用图神经网络作为有效建模多智能体关系与交互的工具,因其擅长处理图结构数据,在节点分类和链接预测等任务中表现优异。接着回顾强化学习领域,特别是多智能体深度强化学习,指出单智能体深度强化学习虽广泛应用于复杂游戏环境,但在多智能体场景中受限于智能体间关系变化及环境非平稳性。描述了现有博弈论解概念,并考虑公平性与稳定性等性质。还讨论了概率主题模型在文档分析之外的应用。最后识别出若干开放挑战:应对非平稳环境、平衡稳定与适应度、处理不确定性与异质性、保障可扩展性与解的可求性。

原文摘要 · Abstract (English)

This paper provides a comprehensive review of mainly GNN, DRL, and PTM methods with a focus on their potential incorporation in strategic multiagent settings. We draw interest in (i) ML methods currently utilized for uncovering unknown model structures adaptable to the task of strategic opponent modeling, and (ii) the integration of these methods with Game Theoretic concepts that avoid relying on assumptions often invalid in real-world scenarios, such as the Common Prior Assumption (CPA) and the Self-Interest Hypothesis (SIH). We analyze the ability to handle uncertainty and heterogeneity, two characteristics that are very common in real-world application cases, as well as scalability. As a potential answer to effectively modeling relationships and interactions in multiagent settings, we champion the use of GNN. Such approaches are designed to operate upon graph-structured data, and have been shown to be a very powerful tool for performing tasks such as node classification and link prediction. Next, we review the domain of RL, and in particular that of multiagent deep reinforcement learning. Single-agent deep RL has been widely used for decision making in demanding game settings. Its application in multiagent settings though is hindered due to, e.g., varying relationships between agents, and non-stationarity of the environment. We describe existing relevant game theoretic solution concepts, and consider properties such as fairness and stability. Our review comes complete with a note on the literature that utilizes probabilistic topic modeling (PTM) in domains other than that of document analysis and classification. Finally, we identify certain open challenges -- specifically, the need to (i) fit non-stationary environments, (ii) balance the degrees of stability and adaptation, (iii) tackle uncertainty and heterogeneity, (iv) guarantee scalability and solution tractability.

多智能体图神经网络强化学习博弈论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。