让语言代理在长期运行中保持目标倾向,不靠记忆查询,而靠选择性参数固化。
Memory Depth, Not Memory Access: Selective Parametric Consolidation for Long-Running Language Agents
- 通过受控干扰测试,用参数存储持久化目标导向行为
- 仅每200事件写入2-3次参数,就能实现0.812-0.904的目标持续性
- 适合研究长期智能体记忆机制的开发者和研究员
长期运行的语言代理不仅需要记忆访问能力。检索系统可在查询时获取过往事实,但无法决定哪些经验应持续影响行为。本文提出‘记忆深度’这一概念:将目标条件化的持久倾向写入小型参数存储。引入循环漂移协议,在工作上下文卸载且经历长周期干扰的条件下,检验目标行为的持续性。评估了EVAF——一种基于意外和情感的LoRA参数固化机制。在GPT-2和TinyLlama上,检索在浅层事实回忆任务中表现最佳(短事实准确率0.956–0.973),而EVAF在目标持续性和卸载后恢复上表现更优(0.812–0.904),且每200事件仅需2–3次参数写入。机制分析表明,选择性固化可分解为选择与执行两个独立维度:随机门控分离出选择作用;跨模型固定内层控制显示写入强度依赖模型;在Mistral-7B上,反向门控揭示执行失调下的选择-执行耦合不对称性。公开的Memora事件流作为外部诊断工具,暴露出陈旧记忆失效这一未解决边界。该机制提供了与检索访问互补的、具有深度的记忆能力。
原文摘要 · Abstract (English)
Long-running language agents need more than memory access. Retrieval systems can fetch past facts at query time, but they do not decide which experiences should continue to shape behavior after the working context is unloaded. We study this separate problem as memory depth: durable goal-conditioned tendencies written into a small parametric store. We introduce the loop-drift protocol, a controlled stress test in which the retrieval index remains intact while working context is unloaded and goal-conditioned behavior must persist under long-loop interference. We evaluate EVAF, a surprise- and valence-gated LoRA consolidation mechanism. Across GPT-2 and TinyLlama, retrieval is strongest on shallow factual recall (short-fact accuracy 0.956--0.973), while EVAF is strongest on goal persistence and post-unload recovery (0.812--0.904) with only 2--3 parametric writes per 200 events. Mechanism controls show that selective consolidation factorizes into two controllable dimensions: selection and actuation. Matched random gates isolate selection beyond sparse writing; fixed-inner controls across GPT-2, TinyLlama, and Mistral-7B show that inner-loop write strength is model-dependent; and a Mistral-7B matched-gate inversion reveals asymmetric selection-actuation coupling under miscalibrated actuation. Public Memora event streams serve as an external diagnostic, exposing stale-memory invalidation as an unresolved boundary. Within this probe, selective parametric consolidation supplies memory depth distinct from and complementary to retrieval access.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。