提出双系统框架,让AI像人一样持续学习并复用计算技能。
Separating the what and how of compositional computation to enable reuse and continual learning
- 分拆‘做什么’和‘怎么做’,用生成模型识别任务阶段结构
- 在线增量学习词汇,实现无遗忘的持续任务组合
- 适合研究持续学习与可复用智能体的学者
持续学习、记忆并部署技能以达成目标是智能高效行为的关键。然而,支持持续学习与灵活技能重组的神经机制仍不明确。本文在循环神经网络(RNN)中研究持续学习与计算的组合复用,提出一种新型双系统方法:一个系统推断‘做什么’,另一个系统实现‘怎么做’。研究聚焦于一组神经科学中常见的组合认知任务。通过概率生成模型系统描述任务,发现其组合性源于共享的离散任务阶段词汇。该词汇结构使任务具有内在组合性。我们开发了一种无监督在线学习方法,在单次试验基础上逐步构建词汇,增量式学习新任务,并在试验内推断时变的计算上下文。‘怎么做’系统由根据上下文推理结果组成的低秩RNN组件构成。上下文推断促进新任务引入时低秩组件的创建、学习与复用,实现无灾难性遗忘的持续学习。在一组示例任务上验证了该框架的有效性与竞争力,展示了其前向与后向迁移潜力,以及对未见任务的快速组合泛化能力。
原文摘要 · Abstract (English)
The ability to continually learn, retain and deploy skills to accomplish goals is a key feature of intelligent and efficient behavior. However, the neural mechanisms facilitating the continual learning and flexible (re-)composition of skills remain elusive. Here, we study continual learning and the compositional reuse of learned computations in recurrent neural network (RNN) models using a novel two-system approach: one system that infers what computation to perform, and one that implements how to perform it. We focus on a set of compositional cognitive tasks commonly studied in neuroscience. To construct the what system, we first show that a large family of tasks can be systematically described by a probabilistic generative model, where compositionality stems from a shared underlying vocabulary of discrete task epochs. The shared epoch structure makes these tasks inherently compositional. We first show that this compositionality can be systematically described by a probabilistic generative model. Furthermore, We develop an unsupervised online learning approach that can learn this model on a single-trial basis, building its vocabulary incrementally as it is exposed to new tasks, and inferring the latent epoch structure as a time-varying computational context within a trial. We implement the how system as an RNN whose low-rank components are composed according to the context inferred by the what system. Contextual inference facilitates the creation, learning, and reuse of low-rank RNN components as new tasks are introduced sequentially, enabling continual learning without catastrophic forgetting. Using an example task set, we demonstrate the efficacy and competitive performance of this two-system learning framework, its potential for forward and backward transfer, as well as fast compositional generalization to unseen tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。