arXiv:2409.13997cs.AIq-bio.NC2024-09被引 1

让AI像大脑一样持续学习,避免遗忘新知识。

Drift to Remember

  • 通过模拟神经活动的表征漂移,动态探索损失曲面中的不同最小值。
  • 在图像分类与自然语言处理任务中超越现有模型,支持大模型增量更新。
  • 适合需要长期迭代训练的大模型研究者,尤其关注低成本持续学习场景。

人工智能中的持续学习旨在模仿生物大脑不断学习并保留知识的能力,但面临灾难性遗忘的挑战。最近的神经科学研究表明,生物系统中的神经活动存在表征漂移现象,即在输入和任务保持一致的情况下,神经反应仍随时间演化。本文假设表征漂移可缓解人工智能在学习新任务时的灾难性遗忘。为此,提出DriftNet:一种网络结构,能持续探索损失景观中的多个局部极小值,并动态检索相关任务,实现新信息高效融合且保留已有知识。在图像分类与自然语言处理任务上的实验表明,DriftNet优于现有模型。尤为重要的是,该方法可在单块Nvidia A100 GPU上扩展应用于包含情感分析、问答等序列任务的大语言模型(如GPT-2与RoBERTa),仅使用新数据即可完成模型更新,无需重新训练全部数据。这不仅推动了类脑持续学习系统的进步,也为理解生物神经系统的自适应机制提供了新视角。

原文摘要 · Abstract (English)

Lifelong learning in artificial intelligence (AI) aims to mimic the biological brain's ability to continuously learn and retain knowledge, yet it faces challenges such as catastrophic forgetting. Recent neuroscience research suggests that neural activity in biological systems undergoes representational drift, where neural responses evolve over time, even with consistent inputs and tasks. We hypothesize that representational drift can alleviate catastrophic forgetting in AI during new task acquisition. To test this, we introduce DriftNet, a network designed to constantly explore various local minima in the loss landscape while dynamically retrieving relevant tasks. This approach ensures efficient integration of new information and preserves existing knowledge. Experimental studies in image classification and natural language processing demonstrate that DriftNet outperforms existing models in lifelong learning. Importantly, DriftNet is scalable in handling a sequence of tasks such as sentiment analysis and question answering using large language models (LLMs) with billions of parameters on a single Nvidia A100 GPU. DriftNet efficiently updates LLMs using only new data, avoiding the need for full dataset retraining. Tested on GPT-2 and RoBERTa, DriftNet is a robust, cost-effective solution for lifelong learning in LLMs. This study not only advances AI systems to emulate biological learning, but also provides insights into the adaptive mechanisms of biological neural systems, deepening our understanding of lifelong learning in nature.

持续学习大模型表征漂移神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。