让普通AI-agent自动进化成领域专家,提升推理效率与准确率
Alita-G: Self-Evolving Generative Agent for Agent Generation
- 通过生成、抽象、整合工具协议,实现Agent自主进化
- 在GAIA数据集上达83.03%通过率,计算量减少15%
- 适合需要高效领域推理的智能系统研发人员
大型语言模型在引入记忆、工具和反馈机制后表现更优。然而现有自演化方法仅限于提示重写或失败重试。为此,我们提出ALITA-G框架,通过系统化生成、抽象和管理模型上下文协议(MCP)工具,将通用代理转变为领域专家。该框架中,通用代理执行目标领域任务并从成功轨迹中合成候选MCP;这些被抽象为参数化原语,并整合进MCP Box。推理时,ALITA-G结合工具描述与使用案例进行检索增强的MCP选择,再执行配备MCP执行器的代理。在GAIA、PathVQA和Humanity's Last Exam等多个基准测试中,ALITA-G均取得显著提升,同时降低计算成本。在GAIA验证集上,获得83.03% pass@1和89.09% pass@3,创出新纪录,且平均每个样本的词元数比强基线减少约15%。因此,ALITA-G提供了一条从通用能力到可复用领域专长的规范化路径,提升了复杂推理任务的准确率与效率。
原文摘要 · Abstract (English)
Large language models (LLMs) have been shown to perform better when scaffolded into agents with memory, tools, and feedback. Beyond this, self-evolving agents have emerged, but current work largely limits adaptation to prompt rewriting or failure retries. Therefore, we present ALITA-G, a self-evolution framework that transforms a general-purpose agent into a domain expert by systematically generating, abstracting, and curating Model Context Protocol (MCP) tools. In this framework, a generalist agent executes a curated suite of target-domain tasks and synthesizes candidate MCPs from successful trajectories. These are then abstracted to parameterized primitives and consolidated into an MCP Box. At inference time, ALITA-G performs retrieval-augmented MCP selection with the help of each tool's descriptions and use cases, before executing an agent equipped with the MCP Executor. Across several benchmarks GAIA, PathVQA, and Humanity's Last Exam, ALITA-G attains strong gains while reducing computation costs. On GAIA validation, it achieves 83.03% pass@1 and 89.09% pass@3, establishing a new state-of-the-art result while reducing mean tokens per example by approximately 15% relative to a strong baseline agent. ALITA-G thus provides a principled pathway from generalist capability to reusable, domain-specific competence, improving both accuracy and efficiency on complex reasoning tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。