让AI agent在测试时通过进化自我改进,突破传统方法局限。
EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systems
- 用演化机制重构代理系统,无需梯度更新
- 在新基准上显著提升性能,成功通关两款游戏
- 适合需要持续自适应的智能体应用
当前AI代理在测试时无法实时学习复杂技能,表现如‘聪明但无措的实习生’,严重限制实用性。为此,我们提出杰里科测试时学习(J-TTL)基准,要求代理在连续多轮游戏中逐步优化表现。实验发现,现有方法如反思、记忆或强化学习均难以应对。为此,我们提出EvoTest框架,通过演化机制在每轮后重构整个代理系统:执行者(Actor)负责游戏,演化工(Evolver)分析回合记录,重写提示、更新记忆、调参并学习工具使用模式。在J-TTL基准上,EvoTest持续提升性能,不仅超越反思与仅用记忆的基线,还优于复杂在线微调方法。尤为关键的是,它是唯一能赢得《侦探》和《图书馆》两款游戏的方法,而所有基线均失败。
原文摘要 · Abstract (English)
A fundamental limitation of current AI agents is their inability to learn complex skills on the fly at test time, often behaving like "clever but clueless interns" in novel environments. This severely limits their practical utility. To systematically measure and drive progress on this challenge, we first introduce the Jericho Test-Time Learning (J-TTL) benchmark. J-TTL is a new evaluation setup where an agent must play the same game for several consecutive episodes, attempting to improve its performance from one episode to the next. On J-TTL, we find that existing adaptation methods like reflection, memory, or reinforcement learning struggle. To address the challenges posed by our benchmark, we present EvoTest, an evolutionary test-time learning framework that improves an agent without any fine-tuning or gradients-by evolving the entire agentic system after every episode. EvoTest has two roles: the Actor Agent, which plays the game, and the Evolver Agent, which analyzes the episode transcript to propose a revised configuration for the next run. This configuration rewrites the prompt, updates memory by logging effective state-action choices, tunes hyperparameters, and learns the tool-use routines. On our J-TTL benchmark, EvoTest consistently increases performance, outperforming not only reflection and memory-only baselines but also more complex online fine-tuning methods. Notably, our method is the only one capable of winning two games (Detective and Library), while all baselines fail to win any.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。