arXiv:2411.03840cs.LGq-bio.NC2024-11NeurIPS被引 7

线性网络通过快速有界门控单元自组织出任务抽象,实现灵活适应环境变化。

Flexible task abstractions emerge in linear networks with fast and bounded units

  • 门控单元以快速、非负且有界的方式调节权重,形成任务专用模块。
  • 门控层切换速度随任务训练时长和课程块大小增加,符合认知神经科学发现。
  • 该机制支持任务与子任务组合泛化,适用于非线性网络的双任务切换。

动物在任意时间尺度变化的动态环境中生存,但数据分布突变对神经网络构成挑战。为适应变化,神经系统的参数大规模调整过程缓慢且易遗忘旧信息。而动物利用分布变化将经验流划分为任务,并关联内部任务抽象,从而灵活选择响应。然而,这种灵活任务抽象如何在神经系统中产生尚不明确。本文分析一种线性门控网络,其权重与门控通过梯度下降联合优化,但门控单元受神经元特性约束:更快的时间尺度、非负性与活动上限。我们观察到权重自发形成专用于特定任务或子任务的模块,而门控层则生成独特表示,用以切换对应权重模块(即任务抽象)。我们通过有效特征空间的解析简化学习动力学,揭示良性循环:快速适应的门控通过保护已有知识促进权重专业化,而权重专业化又进一步加快门控层更新速率。门控层的任务切换速度随课程块大小与任务训练量提升,与认知神经科学关键发现一致。所发现的任务抽象可支持任务及子任务的组合泛化,并扩展至非线性网络在两任务间的切换。本研究提出动物认知灵活性源于神经网络中突触与神经门控的联合梯度下降机制。

原文摘要 · Abstract (English)

Animals survive in dynamic environments changing at arbitrary timescales, but such data distribution shifts are a challenge to neural networks. To adapt to change, neural systems may change a large number of parameters, which is a slow process involving forgetting past information. In contrast, animals leverage distribution changes to segment their stream of experience into tasks and associate them with internal task abstracts. Animals can then respond flexibly by selecting the appropriate task abstraction. However, how such flexible task abstractions may arise in neural systems remains unknown. Here, we analyze a linear gated network where the weights and gates are jointly optimized via gradient descent, but with neuron-like constraints on the gates including a faster timescale, nonnegativity, and bounded activity. We observe that the weights self-organize into modules specialized for tasks or sub-tasks encountered, while the gates layer forms unique representations that switch the appropriate weight modules (task abstractions). We analytically reduce the learning dynamics to an effective eigenspace, revealing a virtuous cycle: fast adapting gates drive weight specialization by protecting previous knowledge, while weight specialization in turn increases the update rate of the gating layer. Task switching in the gating layer accelerates as a function of curriculum block size and task training, mirroring key findings in cognitive neuroscience. We show that the discovered task abstractions support generalization through both task and subtask composition, and we extend our findings to a non-linear network switching between two tasks. Overall, our work offers a theory of cognitive flexibility in animals as arising from joint gradient descent on synaptic and neural gating in a neural network architecture.

认知灵活性门控网络任务抽象自组织

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。