无需人工设计,系统自动拆解任务并动态组合智能体。
MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision
- 用元设计迭代优化智能体配置,不依赖验证集。
- 推理时动态分解任务,最高提升16.69%的推理准确率。
- 适合复杂任务场景,支持简化系统以降低开销。
多智能体系统(MAS)利用大语言模型(LLM)的强大能力,在处理复杂任务方面潜力巨大。然而,现有方法大多依赖人工设计的智能体角色和通信协议,难以适配不同任务且缺乏灵活性。现有自动化方法通常需要验证集调参,生成静态结构,无法在推理时调整,也难简化为更轻量系统。我们提出MAS-ZERO,首个无需监督、可在推理时自演化构建多智能体系统的框架。该框架通过元级设计,针对每个问题实例迭代设计、评估并优化智能体配置,无需验证集。关键在于,它基于可解性与完整性反馈实现动态任务分解与智能体组合,并在合适时降级为更简单系统。在数学推理、研究生级问答、编程及基于搜索的代理任务等多个基准上,使用不同规模的闭源与开源LLM作为后端,实验表明MAS-ZERO显著优于强基线方法:推理任务平均准确率提升最高达16.69%,编程任务提升16.66%,代理任务提升5.45%,同时保持成本效率。
原文摘要 · Abstract (English)
Multi-agent systems (MAS) leveraging the impressive capabilities of Large Language Models (LLMs) hold significant potential for tackling complex tasks. However, most current MAS depend on manually designed agent roles and communication protocols. These manual designs often fail to align with the underlying LLMs' strengths and struggle to adapt to novel tasks. Recent automatic MAS approaches attempt to mitigate these limitations but typically necessitate a validation set for tuning and yield static MAS designs lacking adaptability during inference, while also removing the flexibility to reduce to simpler systems. We introduce MAS-ZERO, the first self-evolved, inference-time framework for automatic MAS design. MAS-ZERO employs meta-level design to iteratively design, critique, and refine MAS configurations tailored to each problem instance, without requiring a validation set. Critically, it enables dynamic problem decomposition and agent composition through meta-feedback on solvability and completeness, and reduction to simpler systems when appropriate. Experiments across reasoning (math and graduate-level QA), coding, and agentic (search-based) benchmarks, using both closed-source and open-source LLM backbones of varying sizes, demonstrate that MAS-ZERO outperforms strong manual and automatic MAS baselines. It achieves substantial average accuracy improvements of up to 16.69% on reasoning, 16.66% on coding, and 5.45% on agentic tasks, while maintaining cost efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。