受大脑左右半球启发,提出新型持续学习模型
In Two Minds about Lifelong Learning: Exploring Hemispheric Redundancy and Specialisation in Neural Models

- 设计不对称双半球架构,模拟睡眠周期中的记忆巩固
- 在三个数据集上实现98.3%、84.9%、29.29%准确率
- 适合研究持续学习与神经机制类比的学者
持续智能系统需具备持续学习能力,但当前机器学习方法在保留旧知识与适应新数据间存在显著挑战。传统方法常需重新训练全部数据,而原始数据因存储、成本或隐私限制难以获取。相比之下,生物体可无灾难性遗忘地持续学习。本文基于已知与记忆巩固相关的神经机制,构建高阶框架,聚焦经验回放、快速眼动睡眠和双侧对称性三概念。提出4MAS(4模块清醒/睡眠)宏观架构,模拟左右半球分工:各具长短时记忆机制,并通过学习任务间的睡眠周期促进记忆巩固。实验表明,该架构在Split-MNIST、Split-Fashion-MNIST和Split-CIFAR-100数据集上分别取得98.3%、84.9%和29.29%的准确率。
原文摘要 · Abstract (English)
Persistent intelligent systems require the ability to learn continually, but current machine learning approaches face significant challenges in this area compared to biological learning systems. Machine learning algorithms typically trade off retention of previously learned information and adaptation to new or changing data patterns. When continual learning capabilities are absent, algorithms must undergo retraining using the entire data set, an approach that becomes impractical when original training data are unavailable due to storage constraints, financial or computational costs, or privacy restrictions. However, biological animals can learn continually, without experiencing catastrophic forgetting. This paper attempts to build a high-level framework for how animals learn and preserve knowledge by modelling neural components and states that are known to be related to memory consolidation. We focus on three concepts: experience replay, REM sleep, and bilaterality. We propose 4MAS (4 Module Awake/Sleep), a novel macroarchitecture demonstrating how machine learning models might benefit from asymmetric hemispheres, each with their own long- and short-term memory mechanisms, and how a period of sleep between incremental learning tasks might benefit memory consolidation. Finally, we present results showing that our architecture achieves competitive results on the Split-MNIST, Split-Fashion-MNIST and Split-CIFAR-100 datasets, with 98.3%, 84.9%, and 29.29% accuracy respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。