用大脑神经结构启发的神经网络,实现动物级联想学习。
Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases
- 基于双舱锥体神经元和混合表征,模拟大脑联想学习机制。
- 无需调参即可学会大量关联,表现媲美动物实验。
- 解释了为何传统学习规则在复杂任务中失效,适合神经科学与类脑计算研究者。
动物通过经验学习预测外部事件的规律,这一过程称为条件化。一种自然机制是刺激替代:原本无意义的刺激,因其可靠预测重要刺激,其神经反应逐渐变得与后者相似。本文提出一种递归神经网络模型,模拟这种刺激替代现象,利用皮层中普遍存在的两类归纳偏置:一是混合刺激表征的表示归纳偏置,二是双舱锥体神经元的结构归纳偏置——后者已被证明是皮层联想学习的基本单元。这些神经元特性支持一种局部可实现、生物合理的学习规则,仅依赖突触处的局部信息。模型能生成多种条件化现象,并在训练量与动物实验相当的情况下,学习大量关联,无需为每个任务进行参数微调。相反,常用的赫布学习规则无法在具有混合选择性的条件下学习通用刺激-刺激关联,且需要任务特异性调参。本框架强调了皮层多舱室神经处理的重要性,揭示其可能赋予哺乳动物进化优势。
原文摘要 · Abstract (English)
Animals learn to predict external contingencies from experience through a process of conditioning. A natural mechanism for conditioning is stimulus substitution, whereby the neuronal response to a stimulus with no prior behavioral significance becomes increasingly identical to that generated by a behaviorally significant stimulus it reliably predicts. We propose a recurrent neural network model of stimulus substitution which leverages two forms of inductive bias pervasive in the cortex: representational inductive bias in the form of mixed stimulus representations, and architectural inductive bias in the form of two-compartment pyramidal neurons that have been shown to serve as a fundamental unit of cortical associative learning. The properties of these neurons allow for a biologically plausible learning rule that implements stimulus substitution, utilizing only information available locally at the synapses. We show that the model generates a wide array of conditioning phenomena, and can learn large numbers of associations with an amount of training commensurate with animal experiments, without relying on parameter fine-tuning for each individual experimental task. In contrast, we show that commonly used Hebbian rules fail to learn generic stimulus-stimulus associations with mixed selectivity, and require task-specific parameter fine-tuning. Our framework highlights the importance of multi-compartment neuronal processing in the cortex, and showcases how it might confer cortical animals the evolutionary edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。