arXiv:2502.04180cs.LGcs.CL2025-02ICML被引 163

用可动态调整的智能体架构搜索,降低推理成本并提升性能。

Multi-agent Architecture Search via Agentic Supernet

论文配图:Multi-agent Architecture Search via Agentic Supernet
图 1 · 摘自论文原文
  • 构建概率化智能体超网络,按需采样不同架构
  • 推理成本降为原有系统的45%以下,准确率提升超11%
  • 适合需要灵活部署与低成本推理的应用场景

大语言模型赋能的多智能体系统通过有纪律的协作扩展了单个智能体的认知边界,但构建这类系统通常依赖繁琐的手动设计。尽管已有自动化方法用于生成智能体工作流,但它们通常寻找静态、复杂且通用的系统,无法根据查询难度和领域动态分配推理资源。为此,本文摒弃单一整体系统的设计思路,转而优化一个概率性、连续的智能体超网络。我们提出MaAS框架,能够从超网络中采样出适配特定查询的智能体系统,实现高质量解决方案与定制化资源分配(如大模型调用次数、工具调用次数、令牌开销)。在六个基准上的综合评估表明,MaAS(I)仅需现有手工或自动化系统6%~45%的推理成本,(II)准确率高出0.54%~11.82%,(III)具备优异的跨数据集和跨大模型底座迁移能力。

原文摘要 · Abstract (English)

Large Language Model (LLM)-empowered multi-agent systems extend the cognitive boundaries of individual agents through disciplined collaboration and interaction, while constructing these systems often requires labor-intensive manual designs. Despite the availability of methods to automate the design of agentic workflows, they typically seek to identify a static, complex, one-size-fits-all system, which, however, fails to dynamically allocate inference resources based on the difficulty and domain of each query. To address this challenge, we shift away from the pursuit of a monolithic agentic system, instead optimizing the \textbf{agentic supernet}, a probabilistic and continuous distribution of agentic architectures. We introduce MaAS, an automated framework that samples query-dependent agentic systems from the supernet, delivering high-quality solutions and tailored resource allocation (\textit{e.g.}, LLM calls, tool calls, token cost). Comprehensive evaluation across six benchmarks demonstrates that MaAS \textbf{(I)} requires only $6\sim45\%$ of the inference costs of existing handcrafted or automated multi-agent systems, \textbf{(II)} surpasses them by $0.54\%\sim11.82\%$, and \textbf{(III)} enjoys superior cross-dataset and cross-LLM-backbone transferability.

多智能体自动架构搜索资源优化大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。