arXiv:2602.02369cs.AIcs.LG2026-02被引 7

让AI记忆随实时反馈动态进化,提升决策能力。

Live-Evo: Online Evolution of Agentic Memory from Continuous Feedback

  • 用经验库与元指南库分离记忆内容与使用方式,实现任务自适应。
  • 10周在线测试中,预测准确率提升20.8%,投资回报提高12.9%。
  • 适合需要持续学习与真实环境反馈的智能体系统开发者。

大型语言模型(LLM)代理正越来越多地配备记忆功能,即存储的经验和可重用的指导,以提升任务解决性能。近期的自演化系统基于交互结果更新记忆,但大多数现有演化流程针对静态训练/测试划分设计,仅通过折叠静态基准近似在线学习,在真实分布漂移和持续反馈下表现脆弱。我们提出 extsc{Live-Evo},一个从连续数据流中学习的在线自演化记忆系统。 extsc{Live-Evo} 通过经验库和元指南库将“发生了什么”与“如何使用”解耦,从检索到的经验中编译出适用于每个任务的自适应指南。为管理在线记忆, extsc{Live-Evo} 维护经验权重并根据反馈进行更新:持续有帮助的经验被强化并更频繁检索,误导或过时的经验则降权并逐渐遗忘,类比于人类记忆中的强化与衰减机制。在为期10周的实时 extit{Prophet Arena} 基准测试中, extsc{Live-Evo} 将Brier得分降低20.8%,市场回报率提升12.9%,同时在深度研究基准上也持续优于强基线。代码已公开于 https://github.com/ag2ai/Live-Evo。

原文摘要 · Abstract (English)

Large language model (LLM) agents are increasingly equipped with memory, which are stored experience and reusable guidance that can improve task-solving performance. Recent \emph{self-evolving} systems update memory based on interaction outcomes, but most existing evolution pipelines are developed for static train/test splits and only approximate online learning by folding static benchmarks, making them brittle under true distribution shift and continuous feedback. We introduce \textsc{Live-Evo}, an online self-evolving memory system that learns from a stream of incoming data over time. \textsc{Live-Evo} decouples \emph{what happened} from \emph{how to use it} via an Experience Bank and a Meta-Guideline Bank, compiling task-adaptive guidelines from retrieved experiences for each task. To manage memory online, \textsc{Live-Evo} maintains experience weights and updates them from feedback: experiences that consistently help are reinforced and retrieved more often, while misleading or stale experiences are down-weighted and gradually forgotten, analogous to reinforcement and decay in human memory. On the live \textit{Prophet Arena} benchmark over a 10-week horizon, \textsc{Live-Evo} improves Brier score by 20.8\% and increases market returns by 12.9\%, while also transferring to deep-research benchmarks with consistent gains over strong baselines. Our code is available at https://github.com/ag2ai/Live-Evo.

智能体在线学习记忆演化强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。