研究大模型代理的部署期记忆机制,揭示记忆设计如何影响个性化、泄露风险和删除效果。
Deployment-Time Memorization in Foundation-Model Agents

- 将记忆设计为可调参数,通过摘要强度、检索范围和删除模式三要素建模
- 压缩摘要可降低76%的恶意提取率,但会引发删除残留问题(20%仍可恢复)
- 提出遗忘残留分数评估删除彻底性,适合关注隐私与长期记忆的系统设计者
基础模型代理正日益成为长期运行的系统,需在交互中持续记住用户信息,使记忆成为部署阶段的显式功能而非仅依赖模型权重。现有工作关注参数化记忆或固定记忆配置的审计,但未刻画记忆设计选择对个性化效用、提取风险与删除保真度的协同影响。本文提出部署期记忆框架,以个性化召回率(PR)和对抗提取率(AER)定义隐私-效用边界,并系统测试三个设计参数:摘要激进度、检索广度(k)和删除模式。引入遗忘残留分数(FRS)量化删除后信息是否仍可从衍生层级恢复。在LongMemEval上,关键事实摘要使Gemma 3 12B的蜜罐提取率下降76%,GPT-4o-mini下降64%,同时几乎完全保留个性化召回;关键的是,一旦内容被压缩,增大k也无法恢复泄漏。然而,相同压缩导致删除保真度失败:仅原始数据删除时,约20%实例仍可恢复衍生摘要;唯有全链路清除或墓碑擦除才能使最底层残留归零。结果表明,持久代理记忆必须作为首等记忆机制来评估——即看它帮助代理记住什么、使什么易被提取、以及能否真正抹除。
原文摘要 · Abstract (English)
Foundation-model agents are increasingly long-lived systems that remember users across interactions, making memorization an explicit deployment-time function rather than solely a property of model weights. Existing work addresses parametric memorization or audits fixed memory configurations, but does not characterize how memory-design choices jointly shape personalization utility, extraction risk, and deletion fidelity. We study this surface as deployment-time memorization, formulating agent memory as a privacy-utility frontier measured by Personalization Recall (PR) and Adversarial Extraction Rate (AER), and sweeping three memory-design knobs: summarization aggressiveness, retrieval breadth (k), and deletion mode. We further introduce the Forgetting Residue Score (FRS) to quantify whether deleted information remains recoverable from derived memory tiers. On LongMemEval, key-fact summarization reduces canary extraction by 76% on Gemma 3 12B and 64% on GPT-4o-mini while preserving nearly all personalization recall; critically, once content is compressed away, increasing k no longer restores leakage. The same compression, however, induces a deletion-fidelity failure: raw-only deletion leaves derived summary copies recoverable in approximately 20% of instances, and only full-pipeline purge or tombstone redaction drives worst-tier residue to zero. Together, these results establish that persistent agent memory must be evaluated as a first-class memorization mechanism -- assessed by what it helps agents recall, what it makes extractable, and what it can truly erase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。