让大模型从模糊目标中自我进化,测试其自主学习能力。
Aspire: Can Models Self-Evolve from Vague Goals?

- 用自然语言目标代替具体任务,让模型自定义学习路径。
- 在520个隐藏评测项上测试,模型自评常不靠谱,效果难迁移。
- 揭示当前模型在权重进化上进展有限,需警惕虚假提升。
许多重要的人类学习始于模糊目标,如“成为更好的物理学家”或“提升研究能力”。学习者需解读目标、识别能力差距、决定学习方式并判断是否进步。相比之下,现有大模型自进化研究通常依赖人类设定的任务和评估指标,将自进化简化为优化明确目标。本文提出ASPIRE,一个以模糊目标驱动的自进化基准。它仅提供自然语言能力目标,下游评测任务保持隐藏。代理必须自行选择数据与更新方法,构建训练与验证信号,并决定何时评估。ASPIRE在统一交互环境中支持模型权重与代理架构的双重进化,并在由专家编写、共520项的隐藏评测集上评估结果,覆盖六个目标。实验表明,模糊目标引导搜索聚焦于目标解读;当前代理虽能完成训练与架构修改循环,但权重层面提升稀疏且不稳定,最强演化的代理仍低于人工设计的Qwen-Agent。代理常使用不匹配数据,过度信任狭隘自评,导致局部提升无法迁移至隐藏评测,持续搜索与训练甚至会抵消先前改进。
原文摘要 · Abstract (English)
Many important forms of human learning begin with a vague goal, such as "become a better physicist" or "improve at research." Learners must interpret the goal, identify capability gaps, decide how to learn, and determine whether they have actually improved. In contrast, existing work on LLM self-evolution typically begins with tasks and evaluation metrics specified by humans, reducing self-evolution to optimizing an explicit objective rather than deciding what and how to learn. We introduce ASPIRE, a benchmark for vague-goal-driven self-evolution. ASPIRE provides only a natural-language capability goal while downstream evaluation tasks remain hidden. The agent must operationalize the goal by choosing data and update methods, constructing training and validation signals, and deciding when to evaluate. ASPIRE supports both model-weight and agent-harness evolution in a unified interactive environment and evaluates the resulting systems on a hidden, expert-authored set of 520 items spanning six goals. Our experiments show that vague goals redirect search effort toward goal interpretation. Current agents routinely complete training and harness-editing loops, but weight-level gains remain sparse and unstable, and the strongest evolved harness remains below the engineered Qwen-Agent reference. Agents often train on mismatched data and trust narrow self-evaluations, so local gains fail to transfer to hidden evaluation and continued search and training can erase earlier improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。