arXiv:2606.00667q-bio.NCcs.LG2026-06

大脑皮层负责学环境规律,皮层下系统专注奖赏学习。

Cortex and subcortex play distinct roles over learning when cortical memory is limited

论文配图:Cortex and subcortex play distinct roles over learning when cortical memory is limited
图 1 · 摘自论文原文
  • 限制皮层记忆资源,模拟真实神经约束
  • 环境变化快时,皮层优先记结构而非当前奖赏
  • 为脑区功能分工提供理论依据,适合神经科学读者

已有理论提出,大脑通过将计算昂贵的皮层处理与低成本的皮层下机制结合,实现比单一系统更高效的资源利用。然而,支持这一假说的完整理论框架仍有限。本文扩展了模型基与模型无关模块协同学习的框架,明确限制模型基模块的记忆资源,并在简单决策任务中研究该约束的影响。记忆限制自然催生资源分配策略。我们评估不同策略在不同情境下的表现,发现当奖励状态频繁变化时,模型基模块将记忆资源用于捕捉环境的普遍结构,反而优于直接利用当前奖赏。这项工作为学习过程中皮层与皮层下系统的功能分离提供了理论基础:皮层支持环境结构学习,而皮层下回路专注于奖赏驱动学习。文章进一步阐述如何在实验数据中验证这些假设。

原文摘要 · Abstract (English)

It has been proposed that the brain integrates flexible, computationally expensive cortical processing with simpler, lower-cost subcortical mechanisms to achieve resource-efficient performance greater than that of either system alone. Despite the allure of this perspective, satisfying theoretical frameworks that explore this hypothesis are still limited. We extend existing frameworks in which a model-based module and model-free module learn in tandem by explicitly constraining the memory resources of the model-based module, and investigate the impact of this constraint in a simple decision-making setting. Memory constraints naturally give rise to strategies for allocating memory resources. We evaluate the performance of different strategies in different situations and demonstrate that when the rewarded states change often, it can be advantageous for the model-based module to focus its memory resources not on exploiting the current reward, but on capturing general structure of the environment. This work provides a theoretical foundation for a functional dissociation between cortical and subcortical systems during learning: the cortex supports general structure learning, while subcortical circuits specialize in reward-based learning. We further detail how these hypotheses can be tested on experimental data.

神经科学学习机制脑区分工

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。