arXiv:2606.19172cs.AI2026-06被引 1

将用户记忆作为局部参数化编辑,实现高效且不干扰的个性化语言模型。

User as Engram: Internalizing Per-User Memory as Local Parametric Edits

论文配图:User as Engram: Internalizing Per-User Memory as Local Parametric Edits
图 1 · 摘自论文原文
  • 用哈希索引的局部记忆表存储用户内容,共享推理适配器保留通用能力。
  • 相比传统LoRA,内存占用减少33,000倍,间接推理准确率提升5.6倍。
  • 支持多用户无冲突叠加,适合需要高并发个性化服务的场景。

语言模型中的个人记忆包含内容与推理能力两部分。大脑将二者分离:事件以稀疏局部痕迹(海马体)存储,通用技能由皮层缓慢演化。当前多数个性化方法将用户事实置于权重外,如自然语言记忆文件或检索索引。当事实写入模型时,标准做法是使用每用户LoRA适配器,却将内容与技能合并为全局权重偏移,导致无关文本被污染。而本研究提出「用户即痕迹(User as Engram)」:将用户内容作为对Engram模型哈希记忆表的精准参数编辑,推理能力则由单一共享适配器承载。该分层设计在保持直接召回能力的同时,平均提升5.6倍间接推理准确率,且不会使任何用户在推理上劣于原始基线。编辑过程为透明机制——仅在触发时刻激活查找,添加所需答案值,其余位置完全不变,错误写入特定层则失败。因不同用户事实落入不重叠哈希槽,其编辑可无损叠加,多个用户共存于同一共享表中;相比之下,单个全局权重偏移的LoRA仅支持一人。在检索阶段,用户痕迹表规模不随搜索人群增长,超过100条事实后,性能超越2.5倍更大的模型检索流水线。

原文摘要 · Abstract (English)

Personal memory in a language model is two problems: content and reasoning skill. The brain keeps the two apart (a sparse, local engram in the hippocampus for each episode, a slow neocortex for the shared skills that interpret it), so a new fact need not overwrite everything else. Most personalization today keeps a user's facts outside the weights, in a natural-language memory file or a retrieval index. When facts are written into the model instead, the standard recipe is the per-user LoRA adapter, which does the opposite of the brain, folding content and skill into one global weight delta. Writing a user's facts as a LoRA contaminates text unrelated to them; writing the same facts as local Engram rows leaves it mathematically untouched, resulting in a roughly 33,000x smaller memory footprint. We therefore propose User as Engram: store a user's content as surgical edits to the hash-keyed memory table of an Engram model, and carry the reasoning skill in one shared adapter. This layered design matches per-user LoRA's direct recall while delivering 5.6x higher indirect-reasoning accuracy on average, and never makes a single user worse at reasoning than the untouched base. The edit is a glass box: writing a fact switches on its lookup at exactly the trigger, adds the value the answer needs, leaves every other position unchanged to the last bit, and fails if written into the wrong layer. Because different users' facts land in disjoint hash slots, their edits compose: many users live in one shared table at once, stacking additively and losslessly, where a per-user LoRA, a single global weight delta, admits only one. Upon retrieval, a per-user Engram table does not grow with the population the retriever must search, so past ~100 facts it overtakes a retrieval pipeline on a 2.5x larger model.

个性化记忆机制参数效率多用户

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。