用分层搜索和价值模型,高效发现更强的LLM智能体设计。
AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search
- 构建分层搜索空间,联合优化工作流与记忆、规划等组件。
- 在7个基准上平均提升8.34%,超越现有自动与人工设计方法。
- 适合想快速探索高性能智能体架构的研究者使用。
大型语言模型(LLM)智能体在多个领域展现出强大能力,但自动化智能体设计仍面临重大挑战。当前方法受限于狭窄的搜索空间,主要优化工作流而忽略记忆、规划、工具使用等关键人工组件,且评估成本高昂——单次评估一个新智能体可能耗资数十美元。搜索策略低效,难以有效探索广阔的设计空间,导致发现新型智能体过程缓慢且资源消耗大。为此,我们提出AgentSwift框架,将智能体工作流与可组合的功能组件统一建模为分层搜索空间,突破仅优化工作流的局限,实现功能组件的协同优化,从而发现更复杂有效的智能体架构。为降低评估成本,我们在高质量数据集上训练价值模型,该数据集通过组合覆盖与平衡贝叶斯采样生成,支持低成本评估。整个过程由分层蒙特卡洛树搜索(MCTS)驱动,并基于不确定性引导,高效导航搜索空间。在涵盖具身、数学、网页、工具和游戏领域的七个基准上,AgentSwift发现的智能体平均性能比现有自动方法和人工设计智能体提升8.34%。本框架为研究者快速发现强大智能体架构提供了有力支持。
原文摘要 · Abstract (English)
Large language model (LLM) agents have demonstrated strong capabilities across diverse domains, yet automated agent design remains a significant challenge. Current automated agent design approaches are often constrained by limited search spaces that primarily optimize workflows but fail to integrate crucial human-designed components like memory, planning, and tool use. Furthermore, these methods are hampered by high evaluation costs, as evaluating even a single new agent on a benchmark can require tens of dollars. The difficulty of this exploration is further exacerbated by inefficient search strategies that struggle to navigate the large design space effectively, making the discovery of novel agents a slow and resource-intensive process. To address these challenges, we propose AgentSwift, a novel framework for automated agent design. We formalize a hierarchical search space that jointly models agentic workflow and composable functional components. This structure moves beyond optimizing workflows alone by co-optimizing functional components, which enables the discovery of more complex and effective agent architectures. To make exploration within this expansive space feasible, we mitigate high evaluation costs by training a value model on a high-quality dataset, generated via a novel strategy combining combinatorial coverage and balanced Bayesian sampling for low-cost evaluation. Guiding the entire process is a hierarchical MCTS strategy, which is informed by uncertainty to efficiently navigate the search space. Evaluated across a comprehensive set of seven benchmarks spanning embodied, math, web, tool, and game domains, AgentSwift discovers agents that achieve an average performance gain of 8.34\% over both existing automated agent search methods and manually designed agents. Our framework serves as a launchpad for researchers to rapidly discover powerful agent architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。