无需任务边界,自动识别任务并高效适配大模型。
Unifying Detection and Adaptation in Task-Free Continual Learning

- 用Fisher信息矩阵检测批次级任务归属。
- 通过正交子空间匹配实现低参数动态适应。
- 适合无任务标签的持续学习场景,参数量少性能强。
为缓解大语言模型在下游持续学习中的灾难性遗忘,现有方法通常限制参数更新或引入任务特定适配模块,但这些方法依赖训练时的显式任务边界,难以应用于真实无任务场景。本文提出一种基于费舍尔信息矩阵(FIM)的统一框架FiUni,用于批次级任务检测与参数高效持续适配。核心观察是:预训练模型的克罗内克分解近似曲率(K-FAC)估计出的主子空间之间具有正交性,可反映不同任务间的相似性。FiUni据此构建由FIM导出的冻结子空间,指导低秩适配(LoRA),并匹配当前批次窗口与历史子空间的费舍尔主子空间。该机制使模型可自适应决定复用已有知识、扩展相关子空间或创建新子空间,动态平衡知识共享与任务隔离。实验表明,FiUni能有效推断隐含的批次级任务归属,在仅使用更少可训练参数的情况下,性能媲美先进任务感知持续学习方法。
原文摘要 · Abstract (English)
To mitigate catastrophic forgetting in downstream continual learning (CL) for large language models (LLMs), existing methods typically constrain parameter updates or introduce task-specific adaptation modules. However, these methods often rely on explicit task boundaries during training, limiting their applicability to realistic task-free scenarios. In this paper, we propose a \textbf{Fi}sher-guided \textbf{uni}fied (\textbf{FiUni}) framework for batch-level task detection and parameter-efficient continual adaptation. FiUni is motivated by a key observation about the Fisher information matrix (FIM) of pre-trained models: the orthogonality among the principal subspaces of its Kronecker-Factored Approximate Curvature (K-FAC) approximation, estimated from a small number of downstream task samples, can reflect the similarity between different tasks. Based on this observation, FiUni constructs FIM-derived frozen subspaces to guide low-rank adaptation (LoRA), while matching the Fisher principal subspace of each incoming batch window with historical subspaces. This enables FiUni to adaptively determine whether to reuse existing knowledge, expand a related subspace, or create a new subspace, dynamically balancing knowledge sharing and task isolation. Experiments show that FiUni can effectively infer latent batch-level task affiliations and achieve competitive performance against advanced task-aware CL methods with fewer trainable parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。