arXiv:2503.02303cs.NEcs.AI2025-03中稿 · the 2025 Conferenc…被引 7

大脑用前额叶调控海马体记忆,实现目标导向的灵活行为泛化。

Flexible Prefrontal Control over Hippocampal Episodic Memory for Goal-Directed Generalization

  • 前额叶生成查询向量,动态检索与目标相关的记忆。
  • 相比自下而上的感知驱动,顶向下控制提升对新环境的泛化能力。
  • 前额叶编码通用表征,适合研究认知控制与智能决策的模型设计。

许多任务需要根据当前目标灵活调整感知和行为。人类可调用数天至数年前的场景记忆,将其用于新但结构相似情境中的行为泛化。这种基于任务需求调控情景记忆的能力,通常归因于前额叶皮层(PFC)与海马体(HPC)之间的交互。我们提出一种强化学习模型,包含PFC-HPC交互机制,实现目标导向的泛化。在该模型中,前额叶学习生成查询-键向量,以编码和检索目标相关的情景记忆,并根据当前任务需求对海马体记忆进行自上而下的调控。此外,当面对分组呈现而非交错呈现的多个目标时,前额叶能动态调整其编码与检索策略。结果显示:(1) 将工作记忆与选择性检索的情景记忆结合,可实现相似环境间决策的迁移;(2) 相较于自下而上的感官驱动方式,前额叶对海马体的顶向下控制显著提升对事件间任意结构关联的学习能力,从而增强在新环境中的泛化表现;(3) 前额叶在记忆编码与检索过程中均形成可泛化的表征,而海马体则保持事件特异性表征。这些发现突显了目标导向的前额叶对海马体情景记忆的调控在新情境决策中的重要性,并揭示了PFC-HPC交互支持灵活行为的计算机制。

原文摘要 · Abstract (English)

Many tasks require flexibly modifying perception and behavior based on current goals. Humans can retrieve episodic memories from days to years ago, using them to contextualize and generalize behaviors across novel but structurally related situations. The brain's ability to control episodic memories based on task demands is often attributed to interactions between the prefrontal cortex (PFC) and hippocampus (HPC). We propose a reinforcement learning model that incorporates a PFC-HPC interaction mechanism for goal-directed generalization. In our model, the PFC learns to generate query-key representations to encode and retrieve goal-relevant episodic memories, modulating HPC memories top-down based on current task demands. Moreover, the PFC adapts its encoding and retrieval strategies dynamically when faced with multiple goals presented in a blocked, rather than interleaved, manner. Our results show that: (1) combining working memory with selectively retrieved episodic memory allows transfer of decisions among similar environments or situations, (2) top-down control from PFC over HPC improves learning of arbitrary structural associations between events for generalization to novel environments compared to a bottom-up sensory-driven approach, and (3) the PFC encodes generalizable representations during both encoding and retrieval of goal-relevant memories, whereas the HPC exhibits event-specific representations. Together, these findings highlight the importance of goal-directed prefrontal control over hippocampal episodic memory for decision-making in novel situations and suggest a computational mechanism by which PFC-HPC interactions enable flexible behavior.

认知神经科学记忆调控强化学习决策建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。