通过分析参数级梯度,区分遗忘与抗遗忘参数,实现高效新知识学习。
Collaborative Parameter Learning: Mitigating Forgetting via Parameter-Level Gradient Analysis
- 按参数级别分解梯度相似性,识别冲突与协作型参数
- 仅更新25%-50%的协作参数,比基线多学20.2%-48.2%问题
- 适用于大模型持续学习,显著降低显存和计算开销
大规模语言模型在注入新知识时面临灾难性遗忘,即覆盖已有知识。现有方法从梯度方向相似性角度缓解遗忘,但主要关注整体方向,忽略了参数级别的贡献差异。本文将梯度相似性分解至参数层级,发现遗忘过程中存在两类参数:冲突参数(占50%-75%)的更新导致遗忘,协作参数(占25%-50%)的更新可缓解遗忘。基于此,提出协同参数学习(CPL),冻结冲突参数,仅更新协作参数。实验表明,相比七种基线方法,CPL在极少遗忘下多学习20.2%-48.2%的问题,每十亿参数减少约3GB峰值显存占用,计算时间降低16.5%。在参数消耗、泛化能力、跨提示、多模态、开放式问答及多语言等场景中均有效缓解遗忘。
原文摘要 · Abstract (English)
Catastrophic forgetting during knowledge injection impairs the ability of large language models to acquire new knowledge without overwriting previously mastered knowledge. Recent studies analyze forgetting from a gradient similarity perspective and mitigate forgetting through vector projection. However, these methods primarily characterize gradient similarity at the aggregate direction level, leaving the parameter wise contributions to forgetting underexplored. In this paper, we decompose gradient similarity into parameter wise contributions and identify two types of parameters during forgetting: Conflicting Parameters, whose updates contribute to forgetting and typically account for 50 percent to 75 percent of parameters, and Collaborative Parameters, whose updates mitigate forgetting and account for 25 percent to 50 percent. Based on this analysis, we propose Collaborative Parameter Learning, CPL, a parameter wise training rule that freezes Conflicting Parameters and updates only Collaborative Parameters. Experiments comparing CPL with seven baseline methods show that CPL learns 20.2% to 48.2% more questions with negligible forgetting, while reducing peak VRAM by approximately 3 GB per billion model parameters and computation time by 16.5 percent. Extensive evaluations on parameter consumption, out of set generalization, cross prompt generalization, multimodal tasks, open ended question answering, and multilingual settings demonstrate that CPL effectively mitigates forgetting across diverse scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。