arXiv:2607.22575cs.AI2026-07

发现大模型靠时间线索重激活实现事件顺序记忆。

Temporal Context Reinstatement Drives Episodic-Like Order Memory in Long-Context Language Models

论文配图:Temporal Context Reinstatement Drives Episodic-Like Order Memory in Long-Context Language Models
图 1 · 摘自论文原文
  • 用时间线索重激活机制解决长文本顺序记忆问题。
  • 模型表现与人类一致,存在距离效应(越远越难记)。
  • 适合研究记忆机制或大模型可解释性的学者参考。

人类情景记忆能回溯长时间跨度的体验,但其计算机制因人类长期记忆实验难以解析而存争议。长上下文大语言模型可能为揭示此类机制提供新途径。本文通过一项基于完整小说记忆的人类行为新数据集,检验模型是否具备情景记忆的核心行为特征。结果表明,模型在时间顺序记忆任务中表现出与人类一致的典型距离效应。进一步采用长上下文可解释性分析发现,模型性能依赖于一维时间编码,并由单一时间重激活注意力头在检索时重建。这些发现支持时间上下文重激活是大模型中类情景时间顺序记忆的关键机制,为人工与生物系统中长期情景记忆的时间特性实现提供了新见解。

原文摘要 · Abstract (English)

Human episodic memory supports the retrieval of experiences that unfold over extended timescales, yet the computational mechanisms underlying this ability remain debated due to the limited mechanistic accessibility in long-term memory experiments in humans. Long-context LLMs may offer promising ways to reveal plausible computational mechanisms that drive this type of retrieval. Here, we investigate whether and how LLMs capture the core behavioral signatures of episodic memory via a temporal order memory task. Using a new dataset of human behavior based on memory of a full-length novel, we show that models exhibit the same characteristic distance effect observed in humans on this task. We next apply long-context mechanistic interpretability analyses to uncover how models solve this task, and find that model performance relies on a one-dimensional temporal code that is reinstated during retrieval by a single time-reinstatement attention head. These findings support temporal context reinstatement as an important mechanism for episodic-like temporal-order memory in LLMs, offering new insights into how temporal aspects of long-term episodic memory may be instantiated in both artificial and biological systems.

记忆机制大模型可解释性时间编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。