用一个模型生成任意任务的智能体协作结构,解决跨领域适应难题。
OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models
- 单个模型通过专家混合架构动态选择子网络生成拓扑。
- 在6个基准上超越专用模型,生成更适配任务的协作图。
- 适合需要快速响应多领域查询的智能体系统设计者。
多智能体系统(MAS)在解决复杂问题时表现出强大潜力,但其性能高度依赖于协作拓扑的设计。随着MAS在搜索引擎等网络服务中的广泛应用,为多样化的跨领域用户查询设计自适应拓扑变得至关重要。现有基于图学习的方法通常采用‘一域一模’模式,为每个特定任务训练专用模型,导致对未见领域的泛化能力差,且无法共享跨任务的结构知识。为此,我们提出OFA-TAD,一种‘一统多’框架,仅用一个通用模型即可根据自然语言描述的任务生成自适应协作图。该方法结合任务感知图状态编码器(TAGSE),通过稀疏门控筛选任务相关节点信息;并采用专家混合(MoE)架构,动态选择专用子网络以驱动节点与边的预测。训练采用三阶段策略:在标准拓扑上进行无条件预训练以获取结构先验,利用大语言模型生成的数据集进行大规模条件预训练以建立任务-拓扑映射,最后在实证验证的图上进行监督微调。在六个不同基准上的实验表明,OFA-TAD显著优于专用的‘一域一模’模型,能生成高度适应性的MAS拓扑结构。代码已开源:https://github.com/Shiy-Li/OFA-MAS。
原文摘要 · Abstract (English)
Multi-Agent Systems (MAS) offer a powerful paradigm for solving complex problems, yet their performance is critically dependent on the design of their underlying collaboration topology. As MAS become increasingly deployed in web services (e.g., search engines), designing adaptive topologies for diverse cross-domain user queries becomes essential. Current graph learning-based design methodologies often adhere to a "one-for-one" paradigm, where a specialized model is trained for each specific task domain. This approach suffers from poor generalization to unseen domains and fails to leverage shared structural knowledge across different tasks. To address this, we propose OFA-TAD, a one-for-all framework that generates adaptive collaboration graphs for any task described in natural language through a single universal model. Our approach integrates a Task-Aware Graph State Encoder (TAGSE) that filters task-relevant node information via sparse gating, and a Mixture-of-Experts (MoE) architecture that dynamically selects specialized sub-networks to drive node and edge prediction. We employ a three-stage training strategy: unconditional pre-training on canonical topologies for structural priors, large-scale conditional pre-training on LLM-generated datasets for task-topology mappings, and supervised fine-tuning on empirically validated graphs. Experiments across six diverse benchmarks show that OFA-TAD significantly outperforms specialized one-for-one models, generating highly adaptive MAS topologies. Code: https://github.com/Shiy-Li/OFA-MAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。