arXiv:2503.06213cs.LG2025-03被引 4

提出AdaLL框架,用适配器实现持续学习中的稳定与泛化平衡。

Lifelong Learning with Task-Specific Adaptation: Addressing the Stability-Plasticity Dilemma

  • 用适配器与主干网络协同训练,主干学通用特征,适配器学任务特有信息。
  • 在多个数据集和任务序列上,性能优于现有方法,提升稳定性和可塑性。
  • 适合需要长期学习新任务且不遗忘旧知识的场景,如智能助手、机器人系统。

持续学习(LL)旨在不断获取新知识的同时保留已有知识。其核心挑战是稳定性-可塑性困境:模型需在保持旧知识(稳定性)与学习新任务(可塑性)之间取得平衡。尽管参数高效微调(PEFT)在大语言模型中广泛应用,但在持续学习中的应用仍不充分。本文提出AdaLL,一种基于适配器的框架,通过简单、通用且有效的方式解决该困境。AdaLL在正则化约束下联合训练主干网络与适配器,使主干网络捕捉任务无关特征,同时适配器专注于任务特定信息。不同于冻结主干的方法,AdaLL在任务增量中逐步增强主干能力,并通过主干正则化最小化干扰。该架构显著提升稳定性与可塑性,有效消除稳定性-可塑性困境。大量实验表明,无论数据集、任务序列或任务规模如何,AdaLL均持续优于现有方法。

原文摘要 · Abstract (English)

Lifelong learning (LL) aims to continuously acquire new knowledge while retaining previously learned knowledge. A central challenge in LL is the stability-plasticity dilemma, which requires models to balance the preservation of previous knowledge (stability) with the ability to learn new tasks (plasticity). While parameter-efficient fine-tuning (PEFT) has been widely adopted in large language models, its application to lifelong learning remains underexplored. To bridge this gap, this paper proposes AdaLL, an adapter-based framework designed to address the dilemma through a simple, universal, and effective strategy. AdaLL co-trains the backbone network and adapters under regularization constraints, enabling the backbone to capture task-invariant features while allowing the adapters to specialize in task-specific information. Unlike methods that freeze the backbone network, AdaLL incrementally enhances the backbone's capabilities across tasks while minimizing interference through backbone regularization. This architectural design significantly improves both stability and plasticity, effectively eliminating the stability-plasticity dilemma. Extensive experiments demonstrate that AdaLL consistently outperforms existing methods across various configurations, including dataset choices, task sequences, and task scales.

持续学习适配器稳定性可塑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。