通过注意力机制连接不同任务的适配器,缓解持续学习中的遗忘问题。
Linked Adapters: Linking Past and Future to Present for Effective Continual Learning
- 用MLP建模注意力权重,实现任务间知识传递
- 在多个图像分类数据集上显著提升持续学习性能
- 适合需要长期学习新任务的模型部署场景
持续学习使系统能在不丢失旧知识的前提下学习新任务。然而,深度学习模型在学习新任务时会严重遗忘早期知识,而对大模型如Transformer重新训练成本高昂。一种有效方法是使用预训练大模型并搭配任务特定适配器进行微调。尽管该方法可缓解灾难性遗忘,但各任务独立训练适配器导致知识无法跨任务迁移。为此,我们提出新方法Linked Adapters,通过加权注意力机制将知识从过往任务传递至当前任务适配器。该方法利用多层感知机(MLP)建模注意力权重,不仅支持前向知识传递,还克服了反向知识传递难题。推理时,基于MLP生成的注意力权重,能有效整合所有横向任务适配器的知识。在多个图像分类数据集上的大量实验验证了其在持续学习任务中的性能提升。
原文摘要 · Abstract (English)
Continual learning allows the system to learn and adapt to new tasks while retaining the knowledge acquired from previous tasks. However, deep learning models suffer from catastrophic forgetting of knowledge learned from earlier tasks while learning a new task. Moreover, retraining large models like transformers from scratch for every new task is costly. An effective approach to address continual learning is to use a large pre-trained model with task-specific adapters to adapt to the new tasks. Though this approach can mitigate catastrophic forgetting, they fail to transfer knowledge across tasks as each task is learning adapters separately. To address this, we propose a novel approach Linked Adapters that allows knowledge transfer through a weighted attention mechanism to other task-specific adapters. Linked adapters use a multi-layer perceptron (MLP) to model the attention weights, which overcomes the challenge of backward knowledge transfer in continual learning in addition to modeling the forward knowledge transfer. During inference, our proposed approach effectively leverages knowledge transfer through MLP-based attention weights across all the lateral task adapters. Through numerous experiments conducted on diverse image classification datasets, we effectively demonstrated the improvement in performance on the continual learning tasks using Linked Adapters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。