任务无关刺激会引发神经表征长期漂移,影响学习稳定性。
Contribution of task-irrelevant stimuli to drift of neural representations
- 用理论与仿真证明,无关刺激噪声导致表征漂移。
- 漂移速率随无关数据方差和维度增大而升高。
- 适用于研究大脑计算机制或改进人工神经网络。
生物与人工学习系统终身暴露于持续的数据流中,需不断适应、学习或选择性忽略输入。近期发现,即使性能稳定,神经表征仍可能随时间缓慢变化,称为表征漂移。理解数据与噪声如何驱动漂移,对揭示神经系统的终身学习机制至关重要。然而,现有研究缺乏对不同架构与学习规则下漂移的系统分析,以及其与任务的关系。本文在在线学习设置中,研究漂移随数据分布的变化,明确显示:即使被学习者忽略的任务无关刺激,也会因学习噪声引发表征漂移。理论与模拟结果表明,该现象在基于赫布学习(如奥加规则、相似性匹配)及随机梯度下降(应用于自编码器与两层监督网络)中均存在。漂移速率随任务无关子空间的数据方差与维度增加而上升。相较高斯突触噪声,此机制预测了不同的几何结构与维度依赖性。本研究将刺激结构、任务与学习规则关联至表征漂移,或可为揭示脑内潜在计算提供新信号。
原文摘要 · Abstract (English)
Biological and artificial learners are inherently exposed to a stream of data and experience throughout their lifetimes and must constantly adapt to, learn from, or selectively ignore the ongoing input. Recent findings reveal that, even when the performance remains stable, the underlying neural representations can change gradually over time, a phenomenon known as representational drift. Studying the different sources of data and noise that may contribute to drift is essential for understanding lifelong learning in neural systems. However, a systematic study of drift across architectures and learning rules, and the connection to task, are missing. Here, in an online learning setup, we characterize drift as a function of data distribution, and specifically show that the learning noise induced by task-irrelevant stimuli, which the agent learns to ignore in a given context, can create long-term drift in the representation of task-relevant stimuli. Using theory and simulations, we demonstrate this phenomenon both in Hebbian-based learning -- Oja's rule and Similarity Matching -- and in stochastic gradient descent applied to autoencoders and a supervised two-layer network. We consistently observe that the drift rate increases with the variance and the dimension of the data in the task-irrelevant subspace. We further show that this yields different qualitative predictions for the geometry and dimension-dependency of drift than those arising from Gaussian synaptic noise. Overall, our study links the structure of stimuli, task, and learning rule to representational drift and could pave the way for using drift as a signal for uncovering underlying computation in the brain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。