让冻结的LLM学会持续记忆,通过向量空间存信息。
Trained Persistent Memory for Frozen Encoder--Decoder LLMs: Six Architectural Methods
- 在冻结模型的连续潜空间中设计六种可微记忆架构
- 10倍容量下所有方法都能实现记忆召回,1倍容量三方法失效
- 适合想研究低成本持续学习的AI工程师
冻结编码器-解码器语言模型是无状态的:每次前向传播后,隐状态即被丢弃,无法跨会话保留信息。本文通过一个概念验证实验表明,在冻结的大型语言模型中实现持续记忆是可行的——即使在严重资源限制下(仅一个冻结的Flan-T5-XL主干、少量可训练适配器、单一数据集)。我们实现了六种架构方法,涵盖三个注入点和四种写入机制;与文本级记忆系统不同,每一次写入和读取都是对密集向量的可微操作。仅训练适配器后,记忆库在推理时仍能持续积累,无需梯度,实现对话式学习。在LoCoMo数据集上进行遗忘曲线评估,无状态基线得分精确为零;10倍容量下,所有六种适配器均产生正的记忆召回曲线;1倍容量下,三种方法失效,揭示容量是关键设计参数。由于记忆库是紧凑的数值数组,可无限扩展容量而不改变主干模型。我们认为,使用更大模型、更多数据和数个数量级更大的记忆进行全端到端训练,将带来显著更强的结果;本研究建立可行性基准与设计空间分类体系,为后续工作提供基础。
原文摘要 · Abstract (English)
Frozen encoder--decoder language models are stateless: the latent representation is discarded after every forward pass, so no information persists across sessions. This paper presents a \textbf{proof-of-concept pilot study} showing that persistent memory in the \emph{continuous latent space} of a frozen LLM is feasible -- even under severe resource constraints (a single frozen Flan-T5-XL backbone, small trainable adapters, a single dataset). We implement six architectural methods spanning three injection points and four write mechanisms; unlike text-level memory systems, every write and read is a differentiable operation on dense vectors. After training only the adapter, the memory bank continues to accumulate at inference time without gradients, enabling \emph{conversational learning}. Under a forgetting-curve evaluation on LoCoMo at two capacity scales (1$\times$ and 10$\times$), the stateless baseline scores exactly zero; at 10$\times$ all six trained adapters produce positive memory-recall curves; at 1$\times$ three methods collapse, revealing capacity as a critical design parameter. Because the memory bank is a compact numerical array, it can be scaled to arbitrarily large capacity without altering the backbone. We argue that full end-to-end training with larger models, larger data, and orders-of-magnitude larger memory will yield substantially stronger results; this pilot study establishes the feasibility baseline and design-space taxonomy that such efforts require.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。