发现缓存的事件能独立传递信息,即使原始输入已丢失。
Compute Globally, Materialize Locally: The Memory Contract of Sparse Event-KV

- 通过移除历史输入测试缓存有效性,发现下游响应仍依赖被删信息。
- 刻意设计无答案事件可使恢复率从6%提升至51%,无需明说答案。
- 缓存内容语义受限,写入效果取决于表达方式而非语义本身。
长时序智能体越来越多地将键值缓存用作记忆:服务系统保留部分缓存条目并丢弃其余。淘汰与情景记忆机制基于一个很少直接验证的前提,即保留的事件在生成它的观测消失后依然具有信息价值。我们通过在其他条件相同的代理历史中省略一项早期观测来测试这一前提。对于受该观测影响的项目,回答几乎完全遵循被省略的值,尽管所有被服务的片段均未说明哪个值是正确的。我们称此为语义实体化:下游事件的缓存行可作为计算的独立可服务视图,其输入已不存在。这种现象也可主动实现。有意构造的无答案事件使 Qwen3-8B 的捐赠对齐恢复率从6%提升至51%,且从未明确指出正确值;而被动捕获长期对话中的自然提及则未表现出显著优势。此类行所承载的信息是具体且有限的:紧凑状态得以保留,大负载内容趋向随机,构建是否写入取决于措辞而非意义本身,因此模型理解程度相当的两种表述可能产生截然不同的结果。最终形成稀疏事件-KV 服务的记忆契约:应写什么、落在何处,以及源消失后何者留存。对于任何进行淘汰的场景,结论是:丢弃源事件后未出现准确率下降,并不意味着该源不必要。
原文摘要 · Abstract (English)
Long-horizon agents increasingly reuse their KV cache as memory: a serving system keeps a subset of cached entries and drops the rest. Eviction and episodic-memory schemes therefore rest on a premise rarely tested directly, that a retained event is still informative once the observations that produced it are gone. We test it by omitting one earlier observation from what is served, across otherwise identical agent histories. Among items sensitive to that observation, the answer overwhelmingly follows the omitted value, though no served span says which value is correct. We call this semantic materialization: a downstream event's cached rows act as an independently servable view of computation whose inputs are gone. It can also be written on purpose. A deliberately phrased, answer-free event raises donor-aligned recovery from 6% to 51% on Qwen3-8B without ever naming the value, whereas passively harvesting natural mentions from long-term dialog yields no detected advantage. What such a row carries is specific and bounded. Compact state survives, larger payloads decay toward chance, and whether a construction writes at all turns on phrasing rather than on meaning alone, so two phrasings the model comprehends equally well can diverge sharply. The result is a memory contract for sparse event-KV serving: what to write, where it lands, and what survives once the source is gone. For anyone who evicts the corollary is that dropping a source event and observing no accuracy loss does not show the source was unnecessary.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。