arXiv:2605.17359cs.CL2026-05

让多智能体大模型跨领域协作更高效,通过学习可复用的结构先验减少每次推理的搜索开销。

Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains

论文配图:Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains
图 1 · 摘自论文原文
  • 离线学习跨领域的通用协作结构先验,线上快速生成初始拓扑
  • 在多个基准上降低推理时的令牌消耗,提升效率且参数增加极少
  • 适合需要高效跨域协作的大模型系统开发者

基于大语言模型的多智能体系统通过结构化通信协调专业代理,在复杂推理中展现出强大潜力。然而,现有拓扑演化方法通常为每个查询从头构建或优化协作拓扑,导致显著的在线搜索开销、高推理阶段令牌消耗,并在多领域场景下扩展性受限。我们提出 TopoPrior,一种面向跨域多智能体大模型协作的可迁移拓扑先验学习框架。与其重复进行在线有效协作结构搜索,TopoPrior 从多个领域的参考协作图中离线学习可复用的拓扑先验,并用于生成查询相关的初始协作图以供后续精炼。通过将部分拓扑搜索从每查询在线优化转移到离线先验学习,TopoPrior 分摊了搜索成本,同时兼容现有拓扑演化主干。技术上,TopoPrior 包含两个关键组件:第一,可迁移拓扑先验学习模块,采用条件变分图框架在隐空间捕捉跨领域的可复用结构规律;第二,查询相关隐空间适应模块,引入对抗对齐以减少不必要的领域差异,同时保留与查询相关的结构变化。在多领域推理基准上的实验表明,TopoPrior 持续提升多个异构拓扑演化主干的性能,同时减少在线推理时的令牌使用量,仅带来少量额外可训练参数。结果表明,可迁移拓扑初始化是提升多智能体大模型跨域协作效率的有效且轻量级机制。

原文摘要 · Abstract (English)

Large language model (LLM)-based multi-agent systems have shown strong potential for complex reasoning by coordinating specialized agents through structured communication. However, existing topology-evolution methods typically construct or optimize a collaboration topology for each query from scratch, leading to substantial online search overhead, high inference-time token consumption, and limited scalability in multi-domain settings. We propose TopoPrior, a framework for learning transferable topology priors for multi-agent LLM collaboration across domains. Rather than repeatedly searching for effective collaboration structures online, TopoPrior learns reusable topology priors from reference collaboration graphs collected offline from multiple domains and uses them to generate query-conditioned initial collaboration graphs for downstream refinement. By shifting part of topology search from per-query online optimization to offline prior learning, TopoPrior amortizes search cost while remaining compatible with existing topology-evolution backbones. Technically, TopoPrior contains two key components. First, a transferable topology prior learning module employs a conditional variational graph framework to capture reusable structural regularities across domains in a latent space. Second, a query-conditioned latent adaptation module introduces adversarial alignment to reduce unnecessary domain discrepancy while preserving query-relevant structural variation. Experiments on multi-domain reasoning benchmarks show that TopoPrior consistently improves several heterogeneous topology-evolution backbones while reducing online inference-time token usage, with only modest additional trainable parameters. These results suggest that transferable topology initialization is an effective and lightweight mechanism for improving the efficiency of multi-agent LLM collaboration across domains.

多智能体大模型拓扑先验跨域协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。