Agent0让智能体零数据自进化,靠双代理互促提升推理能力。
Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
- 双代理协同:一个出难题,一个解题,工具融入增强能力。
- 自进化循环:难题越来越难,解题能力持续提升,数学推理+18%。
- 适合研究自进化、智能体系统或无监督学习的团队使用。
大型语言模型(LLM)智能体通常依赖强化学习和人工标注数据,限制了可扩展性并绑定人类知识。现有自进化框架受限于模型自身能力与单轮交互,难以支持涉及工具使用或动态推理的复杂课程。我们提出Agent0,一种完全自主的框架,通过多步协同进化与无缝工具集成,实现无外部数据下的高绩效智能体演化。Agent0建立两个由同一基础LLM初始化的代理间的共生竞争:课程代理提出日益挑战性的前沿任务,执行代理则学习解决这些任务。通过集成外部工具提升执行代理的问题求解能力,反过来迫使课程代理设计更复杂的、工具感知的任务。这一迭代过程形成自我强化循环,持续生成高质量课程。实验表明,Agent0显著提升推理能力,使Qwen3-8B-Base模型在数学推理上提升18%,通用推理上提升24%。代码已开源。
原文摘要 · Abstract (English)
Large Language Model (LLM) Agents, often trained with Reinforcement Learning (RL), are constrained by a dependency on human-curated data, limiting scalability and tethering AI to human knowledge. Existing self-evolution frameworks offer an alternative but are typically restricted by the model's inherent capabilities and single-round interactions, hindering the development of complex curricula involving tool use or dynamic reasoning. We introduce Agent0, a fully autonomous framework that evolves high-performing agents without external data through multi-step co-evolution and seamless tool integration. Agent0 establishes a symbiotic competition between two agents initialized from the same base LLM: a curriculum agent that proposes increasingly challenging frontier tasks, and an executor agent that learns to solve them. We integrate external tools to enhance the executor's problem-solving capacity; this improvement, in turn, pressures the curriculum agent to construct more complex, tool-aware tasks. Through this iterative process, Agent0 establishes a self-reinforcing cycle that continuously produces high-quality curricula. Empirically, Agent0 substantially boosts reasoning capabilities, improving the Qwen3-8B-Base model by 18% on mathematical reasoning and 24% on general reasoning benchmarks. Code is available at https://github.com/aiming-lab/Agent0.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。