arXiv:2608.07196cs.AI2026-08

让多智能体系统通过经验自动优化结构和提示,提升准确率并降低耗 token 量。

EMAS: Stabilizing Multi-Agent System Evolution through Evidence-Guided Revision

  • 基于样本诊断生成可复用的系统修订方案,不更新大模型参数。
  • 在多个基准上提升任务加权准确率,最高增益达20.10%。
  • 适合需要持续优化、关注成本与性能平衡的研究者或开发者。

现有自动化多智能体系统设计方法通常在初始阶段优化提示和拓扑结构后即固定部署,难以利用后续样本的经验进行迭代。为解决此问题,本文提出 EMAS(Evolving Multi-Agent System),通过将运行轨迹转化为结构化诊断,识别需修订的操作与目标。仅当相同诊断在多个样本中重复出现时,才生成候选修订,并在通过与当前 MAS 的配对验证且满足接受标准后才应用。在四个基准和两个 LLM 上测试显示,EMAS 在所有骨干模型中均取得最高任务加权准确率,且在八组设置中有六组表现最优或并列。经过两轮演化,其在 Kimi-K2-6 和 Qwen3.6-27B 上分别实现 6.30% 和 20.10% 的相对准确率提升;在 MBPP 数据集上,以 Qwen3.6-27B 为基底,准确率从 55.09% 提升至 89.12%,同时每任务耗 token 数减少 62.2%。结果表明,EMAS 能有效将新样本经验转化为可复用的系统更新。

原文摘要 · Abstract (English)

Many methods for automated multi-agent system design optimize prompts and topologies during an initial design stage and then deploy the resulting system unchanged on subsequent samples. Experience from these samples is rarely consolidated into reusable system updates, while accuracy-oriented designs may incur high token costs. We introduce EMAS (Evolving Multi-Agent System), which uses this experience to revise MAS topology and prompts without updating LLM parameters, either to improve accuracy or to reduce cost. EMAS converts traces into structured diagnoses that specify a revision operation and target. It generates a candidate revision only when the same diagnosis recurs across samples and applies it only if paired validation against the current MAS meets the corresponding acceptance criterion. Across four benchmarks and two LLMs, EMAS attains the highest task-weighted overall accuracy for both backbones and is best or tied in six of eight model--benchmark settings. Within two evolution epochs, EMAS achieves relative gains of 6.30% and 20.10% in task-weighted accuracy on Kimi-K2-6 and Qwen3.6-27B, respectively. On MBPP with Qwen3.6-27B, EMAS raises accuracy from 55.09% to 89.12% while reducing token use per task by 62.2%. These results show that EMAS can turn experience from new samples into reusable updates to MAS topology and prompts.

多智能体系统演化提示优化高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。