用模块化技能包实现大模型间能力高效融合,避免遗忘且支持持续学习。
Knowledge Fusion of Large Language Models Via Modular SkillPacks
- 将大模型能力封装为可移植的SkillPack模块,按需注入目标模型。
- 在多任务场景下相比基线提升12.3%性能,且无灾难性遗忘。
- 适合需要持续更新、异构模型融合的工业级AI系统部署。
跨能力迁移是大语言模型研究的关键挑战,广泛应用于多任务整合、模型压缩与持续学习。现有方法如FuseLLM和FuseChat已证明可将多个模型能力迁移到轻量级模型中,提升适应性与效率,这促使我们探索更高效的跨能力迁移方案。然而,当前方法主要针对小型同质模型,难以适用于大型异构模型。全参数微调的知识蒸馏常忽视学生模型自身容量,易导致灾难性遗忘;而参数高效微调(PEFT)方法又难以有效吸收源大模型的知识。为此,我们提出GraftLLM,一种将源模型能力以SkillPack格式存入目标模型的新方法。该方法保留通用能力,减少参数冲突,支持无遗忘的持续学习与模型融合。通过模块感知的自适应压缩策略,对参数更新进行高效压缩,在保持任务特定知识的同时降低存储开销。生成的SkillPack作为紧凑、可迁移的知识载体,适用于异构模型融合与持续学习。实验表明,GraftLLM在知识迁移、融合及无遗忘学习方面均优于现有技术,提供了一种可扩展、高效的跨能力迁移解决方案。代码已开源:https://github.com/duguodong7/GraftLLM。
原文摘要 · Abstract (English)
Cross-capability transfer is a key challenge in large language model (LLM) research, with applications in multi-task integration, model compression, and continual learning. Recent works like FuseLLM and FuseChat have demonstrated the potential of transferring multiple model capabilities to lightweight models, enhancing adaptability and efficiency, which motivates our investigation into more efficient cross-capability transfer methods. However, existing approaches primarily focus on small, homogeneous models, limiting their applicability. For large, heterogeneous models, knowledge distillation with full-parameter fine-tuning often overlooks the student model's intrinsic capacity and risks catastrophic forgetting, while PEFT methods struggle to effectively absorb knowledge from source LLMs. To address these issues, we introduce GraftLLM, a novel method that stores source model capabilities in a target model with SkillPack format. This approach preserves general capabilities, reduces parameter conflicts, and supports forget-free continual learning and model fusion. We employ a module-aware adaptive compression strategy to compress parameter updates, ensuring efficient storage while maintaining task-specific knowledge. The resulting SkillPack serves as a compact and transferable knowledge carrier, ideal for heterogeneous model fusion and continual learning. Experiments across various scenarios demonstrate that GraftLLM outperforms existing techniques in knowledge transfer, knowledge fusion, and forget-free learning, providing a scalable and efficient solution for cross-capability transfer. The code is publicly available at: https://github.com/duguodong7/GraftLLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。