arXiv:2602.11322cs.LGcs.AI2026-02被引 3

让记忆通过时间共现关联,而非相似性检索。

Predictive Associative Memory: Retrieval Beyond Similarity Through Temporal Co-occurrence

  • 用时间共现训练预测器,学习嵌入空间中的关联结构。
  • 97%的召回结果是真实的时间关联项,跨边界召回率达42.1%。
  • 适用于需精准回忆关联事件的场景,如生物记忆建模。

当前神经系统的记忆方法依赖相似性检索:给定查询,寻找最相似的存储状态。这一假设忽略了生物记忆的核心特性——通过时间共现形成关联。本文提出预测性关联记忆(Predictive Associative Memory, PAM),其架构基于JEPA风格的预测器,通过连续经验流中的时间共现进行训练,学习嵌入空间中的关联结构。引入内向JEPA(Inward JEPA)用于存储经验(预测可关联的过去状态),与外向JEPA(Outward JEPA)对应,后者处理输入感官数据并预测未来状态。将PAM作为关联回忆系统评估,而非泛化至未见关联的检索系统。在合成基准上,预测器的最高召回项为真实时间关联的概率达97%(Association Precision@1 = 0.970);跨边界召回率@20为0.421(余弦相似度为0);对共同经历与从未共现状态的区分判别AUC为0.916(余弦为0.789)。即使仅限于跨房间配对(嵌入相似性无意义),预测器仍达AUC=0.849(余弦0.503,随机水平)。时间打乱对照实验确认信号来自真实时间共现结构,而非嵌入几何:打乱后跨边界召回下降90%,且在不同训练种子间稳定(标准差<0.006),查询选择差异极小(标准差≤0.012)。

原文摘要 · Abstract (English)

Current approaches to memory in neural systems rely on similarity-based retrieval: given a query, find the most representationally similar stored state. This assumption -- that useful memories are similar memories -- fails to capture a fundamental property of biological memory: association through temporal co-occurrence. We propose Predictive Associative Memory (PAM), an architecture in which a JEPA-style predictor, trained on temporal co-occurrence within a continuous experience stream, learns to navigate the associative structure of an embedding space. We introduce an Inward JEPA that operates over stored experience (predicting associatively reachable past states) as the complement to the standard Outward JEPA that operates over incoming sensory data (predicting future states). We evaluate PAM as an associative recall system -- testing faithfulness of recall for experienced associations -- rather than as a retrieval system evaluated on generalisation to unseen associations. On a synthetic benchmark, the predictor's top retrieval is a true temporal associate 97% of the time (Association Precision@1 = 0.970); it achieves cross-boundary Recall@20 = 0.421 where cosine similarity scores zero; and it separates experienced-together from never-experienced-together states with a discrimination AUC of 0.916 (cosine: 0.789). Even restricted to cross-room pairs where embedding similarity is uninformative, the predictor achieves AUC = 0.849 (cosine: 0.503, chance). A temporal shuffle control confirms the signal is genuine temporal co-occurrence structure, not embedding geometry: shuffling collapses cross-boundary recall by 90%, replicated across training seeds. All results are stable across seeds (SD < 0.006) and query selections (SD $\leq$ 0.012).

记忆模型时间共现关联检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。