arXiv:2604.17191cs.LG2026-04

用LLM从自然语言生成协作图先验,提升多智能体协调能力

Do LLM-derived graph priors improve multi-agent coordination?

  • 通过自然语言描述推断智能体间潜在协作关系,生成图结构先验
  • 在MPE基准上实现优于独立学习和现有图方法的协同性能
  • 1.5B参数以下模型即可有效生成先验,适合资源受限场景

多智能体强化学习(MARL)对分布式与对抗性环境中的协同AI系统至关重要,尤其在多领域作战(MDO)中。现有协作建模方法需手动设定图拓扑、依赖邻近启发式或完全从环境交互中学习,均存在脆弱、语义缺失或数据密集等缺陷。本文研究大语言模型(LLM)能否通过少量自然语言描述的观测信息,推断隐含协作模式并生成有效的协调图先验。这些先验通过图神经网络(GNN)中的图卷积层融入MARL算法,在多智能体粒子环境(MPE)的四个合作任务上评估,对比涵盖从独立学习到前沿图方法的全谱系基线。进一步在五个小型开源LLM上进行消融实验,分析先验质量对模型选择的敏感性。结果首次提供定量证据:LLM生成的图先验能显著提升动态多智能体环境中的协调性与适应性,且仅需1.5B参数规模的模型即可有效生成。

原文摘要 · Abstract (English)

Multi-agent reinforcement learning (MARL) is crucial for AI systems that operate collaboratively in distributed and adversarial settings, particularly in multi-domain operations (MDO). A central challenge in cooperative MARL is determining how agents should coordinate: existing approaches must either hand-specify graph topology, rely on proximity-based heuristics, or learn structure entirely from environment interaction; all of which are brittle, semantically uninformed, or data-intensive. We investigate whether large language models (LLMs) can generate useful coordination graph priors for MARL by using minimal natural language descriptions of agent observations to infer latent coordination patterns. These priors are integrated into MARL algorithms via graph convolutional layers within a graph neural network (GNN)-based pipeline, and evaluated on four cooperative scenarios from the Multi-Agent Particle Environment (MPE) benchmark against baselines spanning the full spectrum of coordination modeling, from independent learners to state-of-the-art graph-based methods. We further ablate across five compact open-source LLMs to assess the sensitivity of prior quality to model choice. Our results provide the first quantitative evidence that LLM-derived graph priors can enhance coordination and adaptability in dynamic multi-agent environments, and demonstrate that models as small as 1.5B parameters are sufficient for effective prior generation.

多智能体图神经网络大模型应用强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。