arXiv:2502.07373cs.LGcs.CL2025-02被引 51

用进化算法自动生成多样化低成本智能体流程,性能更优且省钱。

EvoFlow: Evolving Diverse Agentic Workflows On The Fly

  • 基于标签检索与遗传操作,动态演化异构智能体工作流。
  • 在7个基准上比人工和现有自动化方法提升1.23%~29.86%。
  • 用弱模型实现强效果,成本仅为o1-preview的12.4%。

过去两年,基于大语言模型(LLM)的多智能体系统从人工设计逐步走向部分自动化(如提示工程、通信拓扑),最终迈向全自动化设计。然而,现有自动化流程通常缺乏模型异质性,仅关注单一目标性能优化,难以利用较弱模型组合实现定制化、低成本解决方案。为此,我们提出EvoFlow,一种基于分型进化算法的框架,可自动搜索一组异构且复杂度自适应的智能体工作流,而非单一同质复杂工作流。技术上,EvoFlow执行(1)基于标签的检索以从智能体群体中提取父代工作流,通过(2)交叉和(3)变异演化新工作流,并采用(4)基于分型的选择机制维持种群多样性与质量。在七个基准上的大量评估表明,EvoFlow具备:(I)多样性,演化出从简单输入输出任务到复杂多轮交互的多种工作流;(II)高性能,优于先前的手工及自动化工作流,提升1.23%~29.86%;(III)经济性,使用较弱的开源模型,在仅12.4%的推理成本下超越强大的 extit{llmname{o1-preview}}。

原文摘要 · Abstract (English)

The past two years have witnessed the evolution of large language model (LLM)-based multi-agent systems from labor-intensive manual design to partial automation (\textit{e.g.}, prompt engineering, communication topology) and eventually to fully automated design. However, existing agentic automation pipelines often lack LLM heterogeneity and focus on single-objective performance optimization, limiting their potential to combine weaker models for more customized and cost-effective solutions. To address this challenge, we propose EvoFlow, a niching evolutionary algorithm-based framework to automatically search a population of heterogeneous and complexity-adaptive agentic workflows, rather than a single homogeneous, complex workflow. Technically, EvoFlow performs \textit{(1) tag-based retrieval} to extract parent workflows from an agentic population, evolves new workflows through \textit{(2) crossover} and \textit{(3) mutation}, and employs \textit{(4) niching-based selection} to maintain population diversity and quality. Extensive evaluations across seven benchmarks demonstrate that EvoFlow is: \textbf{(I) diverse}, evolving a population of workflows ranging from simple I/O tasks to complex multi-turn interactions; \textbf{(II) high-performing}, outperforming previous handcrafted and automated workflows by $1.23\%\sim29.86\%$; \textbf{(III) economical}, surpassing powerful \llmname{o1-preview} at $12.4\%$ of its inference cost using weaker open-source models.

智能体系统进化算法多模态低成本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。