通过抑制性交叉通信实现记忆侧化,提升联想记忆能力。
Inhibitory Cross-Talk Enables Functional Lateralization in Attention-Coupled Latent Memory
- 用注意力机制统一检索、巩固和写回操作,基于格拉姆矩阵重定位记忆。
- 抑制性连接使两侧记忆区专一化,关联记忆损失降低124倍。
- 适合研究神经网络侧化机制或需要强联想记忆的任务。
我们提出一种增强型变压器模型,其中注意力同时作为检索、巩固和写回操作符。核心更新 $A^ op A V W$ 通过格拉姆矩阵 $A^ op A$ 将检索到的值重新锚定到持久记忆槽中,实现观察空间 → 隐式记忆 → 监督变换的三阶段投影。将记忆分为左右两个侧化存储区,通过符号控制的交叉通信矩阵 $W_s$ 联结,发现其符号对功能分化至关重要。兴奋性交叉($s=+1$)导致单边主导,$/mathcal{P}_{ct} o 0.5$,尽管任务损失降低。抑制性交叉($s=-1$)模拟人类皮层胼胝体的净抑制效应,主动抑制对侧激活,实现饱和分化($/mathcal{D}_{sep} = \pm 1.00$,$/mathcal{P}_{ct} \approx 0$)。在结合情景双射密钥(需关联回忆)与严格数列规律(需规则提取)的基准测试中,抑制性模型在密钥域损失降低124倍,而数列域表现与基线一致,证明持久侧化记忆对情景回忆必要,但对规则预测非必需。
原文摘要 · Abstract (English)
We present a memory-augmented transformer in which attention serves simultaneously as a retrieval, consolidation, and write-back operator. The core update, $A^\top A V W$, re-grounds retrieved values into persistent memory slots via the Gram matrix $A^\top A$, providing a principled tripartite projection: observation space $\to$ latent memory $\to$ supervised transformation. We partition the memory into lateralized left and right banks coupled through a sign-controlled cross-talk matrix $W_s$, and show that the sign of this coupling is decisive for specialization. Excitatory cross-talk ($s=+1$) causes bank-dominance collapse: one bank monopolises all inputs and $\mathcal{P}_{ct} \to 0.5$, despite lowering task loss. Inhibitory cross-talk ($s=-1$), motivated by the net inhibitory effect of callosal projections in human cortex, actively suppresses contralateral bank activation and achieves saturated specialization ($\mathcal{D}_{sep} = \pm 1.00$, $\mathcal{P}_{ct} \approx 0$). On a controlled symbolic benchmark combining an episodic bijection cipher (requiring associative recall) with a strict arithmetic progression (requiring rule extraction), the inhibitory model reduces cipher-domain loss by $124{\times}$ over the baseline while matching it on the arithmetic domain, confirming that persistent lateralized memory is necessary for episodic recall but not for rule-based prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。