arXiv:2606.25449cs.CLcs.AI2026-06被引 5

错误记忆比空白记忆更危险,因模型会自信重复过时结论。

Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One

论文配图:Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One
图 1 · 摘自论文原文
  • 用可回溯的源头替代答案来压缩记忆,提升纠错能力。
  • 相同存储预算下,源优先策略使模型恢复正确性,而传统方法失效。
  • 在真实对话与部署系统中验证,适用于需高可靠性的AI应用。

当语言模型或其接口倾向于依赖记忆时,错误记忆可能比无记忆更糟糕:若记忆保留错误结论但丢失推导过程,模型会以自信姿态重复过时答案;而空记忆则促使模型选择不回答。我们称此为脆弱记忆。信息损失是定义性的,发现基于行为,关键在于记忆是否保存可重算的源头而非最终答案。通过回收评估(reclaim evaluation)进行测量:引入已知偏差,固定预算压缩,提供修正提示并评分精确恢复,无需判断。固定预算、仅改变压缩内容,可分离可纠正性与能力及规模;80亿参数模型与前沿模型在相同瓶颈处停滞。采用仅保留源头的一行策略,在长度匹配控制下排除‘文本更多’的干扰,能恢复可纠正性,前提是源头紧凑且可识别。我们定位修复失败的场景,展示错误在记忆循环中累积,并在三个部署系统中复现,涵盖真实对话(MultiWOZ)和τ基准(tau-bench),表明损失记忆是否演变为有害行为,是模型与接口共同决定的属性。我们发布评估框架、成对记忆条件及伪造检测器。

原文摘要 · Abstract (English)

A language model's memory can be worse than no memory at all when the model or its interface is disposed to act on it: a memory that keeps a wrong conclusion but drops the work behind it leads a model to re-emit the stale value as a confident answer, where an empty memory leads it to abstain. We call this brittle memory. The information loss is definitional; the finding is behavioral, and it turns on one thing, whether the memory kept a re-derivation basis (the source) rather than the answer. We measure it with reclaim evaluation: induce a known drift, compress at a fixed budget, deliver a correction that names the error, and score exact recovery, judge-free. Holding the budget fixed and varying only what the compression keeps isolates correctability from capability and from size; an 8B model and a frontier one wall in the same place. A one-line source-first policy, keep the recomputable source, drop the re-derivable conclusion, restores correctability at equal budget where the source is compact and identifiable, with a length-matched control ruling out "more text." We map where the fix fails, show the failure compounds through memory loops, and replicate across three deployed memory systems, real dialogue (MultiWOZ), and tau-bench, a deployed-agent benchmark where whether a lossy memory becomes a harmful action is a joint model-and-interface property. We release the harness, the paired memory conditions, and validators built to come out false.

记忆机制模型可靠性语言模型评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。