让大模型像生物一样自主进化,持续适应真实世界变化。
Position: Agentic Evolution is the Path to Evolving LLMs
- 构建自驱动进化系统,将改进过程变为有目标的优化任务。
- 实验证明进化能力随计算资源投入线性增长,可实现持续适应。
- 适合关注长期演进、开放环境部署的大模型研究者。
随着大语言模型从受控训练集走向开放的真实世界环境,一个根本性局限浮现:静态训练无法跟上部署环境的持续变化。增加训练和推理阶段的计算虽能提升静态能力,但无法弥合训练与部署之间的差距。我们认为,解决这一问题需要引入新的扩展维度——进化。现有部署时适应方法(如参数微调或启发式记忆积累)缺乏诊断失败并产生持久改进所需的策略性智能。我们的主张是,代理式进化将成为大模型适应的必然未来,将进化本身从固定流程升级为自主演化的智能体。我们提出通用框架A-Evolve,将部署时的改进视为对持久系统状态的目标导向优化过程。进一步提出进化扩展假设:适应能力随分配给进化的计算量而增长,使代理式进化成为实现真实世界中持续、开放适应的可扩展路径。代码已公开于 https://github.com/A-EVO-Lab/a-evolve。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time and inference-time compute improves static capability but does not close this train-deploy gap. We argue that addressing this limitation requires a new scaling axis-evolution. Existing deployment-time adaptation methods, whether parametric fine-tuning or heuristic memory accumulation, lack the strategic agency needed to diagnose failures and produce durable improvements. Our position is that agentic evolution represents the inevitable future of LLM adaptation, elevating evolution itself from a fixed pipeline to an autonomous evolver agent. We instantiate this vision in a general framework, A-Evolve, which treats deployment-time improvement as a deliberate, goal-directed optimization process over persistent system state. We further propose the evolution-scaling hypothesis: the capacity for adaptation scales with the compute allocated to evolution, positioning agentic evolution as a scalable path toward sustained, open-ended adaptation in the real world. Our code is publicly available at https://github.com/A-EVO-Lab/a-evolve.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。