arXiv:2606.20954cs.CLcs.AI2026-06

用不到几KB的模型,智能记住关键信息,避免聊天机器人因记不住而出错。

Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning

论文配图:Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning
图 1 · 摘自论文原文
  • 用轻量学习模型判断历史记录哪些重要,直接保留原文不丢
  • 在任务成功率上超越所有基线,峰值上下文减少52%
  • 无需神经网络,训练时不用人工标注也能达到95%效果

长期运行的语言模型系统会积累超出上下文窗口的历史数据,必须不断删除旧内容。若删除了关键信息(如登录令牌或下一步路径),操作就会失败。本文提出LRE(Learned Relevance Eviction)——一种仅需几KB、纯CPU运行、无需语言模型的评分器,能学习识别哪些历史片段是关键负载,并通过原样提取方式保留。在同等预算下,无任何基线优于LRE。在代理任务中,其准确率与保留全部历史相当;在简单任务上,比不删除策略高出27%,且零调用压缩器,峰值上下文降低最多52%。控制实验显示,其他策略陷入循环,而LRE完成任务仅需比全保留少37%调用,还解决了14个其他方法无法完成的任务。在对话记忆中,其表现优于密集编码和删词编码,且零神经计算成本。下游评估中,于LoCoMo阅读任务上以68%更少的标记数实现最佳预算答案质量。其训练可完全无需标注:仅基于系统自身行为即可恢复95%监督评分器效能。我们主张,大模型代理的内存淘汰本质是保真问题,需要一个可部署的主动策略,未来查询不可知且精确状态决定成败,而廉价学习的相关性判断已足够。

原文摘要 · Abstract (English)

Long-running language-model systems accumulate interaction history that outgrows the context window, so they must continually evict. When an eviction policy drops a load-bearing detail, for example an access token issued at login or a path the next call needs, the action fails. We present LRE (Learned Relevance Eviction), a few kilobytes, CPU-only, language-model-free scorer that learns which units of history are load-bearing and keeps them by verbatim extraction. Under a matched-budget comparison, in our experiment, no baseline dominates LRE on the accuracy-cost plane. On agents, LRE matches the accuracy of keeping the entire history overall. On the simplest tasks, it exceeds that no-eviction baseline by 27%, while requiring zero compressor calls and reducing peak context size by up to 52%. A controlled study trace shows LRE completes tasks where the others loop, finishing one such task in 37% fewer calls than keeping everything and solving 14 tasks where no other run policy does. On conversational memory, LRE outranks dense and token-pruning encoders at zero neural cost. In downstream evaluation, LRE gives the best budgeted answer quality on LoCoMo reading 68% fewer tokens. Its supervision can also be annotation-free: training only on the system's own behavior recovers 95% of the supervised scorer's effectiveness. We argue that, because memory eviction in LLM agents is a fidelity problem, it requires a deployable proactive policy where the future query is unavailable and exact state is decisive, and that cheap learned relevance can be sufficient.

记忆管理轻量模型智能淘汰代理系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。