arXiv:2510.07799cs.CLcs.AI2025-10被引 9

用扩散模型动态生成适配任务的LLM智能体通信结构,提升协作效率。

Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models

  • 通过迭代式扩散过程生成通信拓扑,每步由轻量代理模型引导优化。
  • 在多基准测试中实现更稀疏、高效且适应性强的通信结构,性能显著超越现有方法。
  • 适合需要动态调整协作模式的复杂多智能体系统研究者使用。

由大语言模型驱动的多智能体系统的效率很大程度上取决于其通信拓扑结构。然而,设计最优拓扑是一项非平凡挑战,需在任务性能、通信成本和鲁棒性等目标间取得平衡。现有框架通常依赖静态或人工设计的拓扑,难以适应多样化的任务需求,导致简单任务产生过多令牌消耗,复杂任务则出现性能瓶颈。为此,我们提出一种新型生成框架——引导拓扑扩散(Guided Topology Diffusion, GTD)。受条件离散图扩散模型启发,GTD将拓扑合成建模为迭代构建过程。每一步生成均由一个轻量级代理模型引导,该模型预测多目标奖励(如准确率、效用、成本),实现无梯度、实时的任务自适应优化。这一迭代引导合成机制使GTD区别于单步生成框架,能够更好应对复杂的权衡问题。我们在多个基准上验证了GTD,实验表明该框架能生成高度任务自适应、稀疏且高效的通信拓扑,在大语言模型智能体协作中显著优于现有方法。

原文摘要 · Abstract (English)

The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives such as task performance, communication cost, and robustness. Existing frameworks often rely on static or hand-crafted topologies, which inherently fail to adapt to diverse task requirements, leading to either excessive token consumption for simple problems or performance bottlenecks for complex ones. To address this challenge, we introduce a novel generative framework called \textit{Guided Topology Diffusion (GTD)}. Inspired by conditional discrete graph diffusion models, GTD formulates topology synthesis as an iterative construction process. At each step, the generation is steered by a lightweight proxy model that predicts multi-objective rewards (e.g., accuracy, utility, cost), enabling real-time, gradient-free optimization towards task-adaptive topologies. This iterative, guided synthesis process distinguishes GTD from single-step generative frameworks, enabling it to better navigate complex design trade-offs. We validated GTD across multiple benchmarks, and experiments show that this framework can generate highly task-adaptive, sparse, and efficient communication topologies, significantly outperforming existing methods in LLM agent collaboration.

多智能体拓扑生成扩散模型LLM协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。