通过参数竞争平衡提升多模型融合性能,无需训练即可实现跨任务协同。
Parameter Competition Balancing for Model Merging
- 引入参数内平衡与外平衡机制,量化各参数重要性。
- 在跨任务、跨领域等场景中显著提升融合模型表现。
- 轻量无训练设计,适合多种模型和任务组合使用。
尽管微调预训练模型已成为常态,但这些模型在特定领域外表现往往不佳。近期提出的模型融合技术可直接整合多个针对不同任务微调的模型,形成单一模型,从而在不重训原始数据集的情况下实现多任务能力。然而,现有方法未能有效解决任务间参数调整中的冲突与复杂相关性问题,难以平衡不同任务间的参数竞争。本文提出一种名为PCB-Merging(参数竞争平衡)的新技术,该方法无需训练且轻量,通过内平衡评估单个任务中参数的重要性,外平衡衡量不同任务间参数的相似性。重要性低的参数被剔除,剩余参数经重新缩放后生成最终融合模型。我们在跨任务、跨域、跨训练配置及域外泛化等多种场景下评估该方法,结果表明其在多模态、多领域、不同模型规模、任务数量、微调形式以及大语言模型上均显著优于现有融合方法。代码已公开于: https://github.com/duguodong7/pcb-merging。
原文摘要 · Abstract (English)
While fine-tuning pretrained models has become common practice, these models often underperform outside their specific domains. Recently developed model merging techniques enable the direct integration of multiple models, each fine-tuned for distinct tasks, into a single model. This strategy promotes multitasking capabilities without requiring retraining on the original datasets. However, existing methods fall short in addressing potential conflicts and complex correlations between tasks, especially in parameter-level adjustments, posing a challenge in effectively balancing parameter competition across various tasks. This paper introduces an innovative technique named PCB-Merging (Parameter Competition Balancing), a lightweight and training-free technique that adjusts the coefficients of each parameter for effective model merging. PCB-Merging employs intra-balancing to gauge parameter significance within individual tasks and inter-balancing to assess parameter similarities across different tasks. Parameters with low importance scores are dropped, and the remaining ones are rescaled to form the final merged model. We assessed our approach in diverse merging scenarios, including cross-task, cross-domain, and cross-training configurations, as well as out-of-domain generalization. The experimental results reveal that our approach achieves substantial performance enhancements across multiple modalities, domains, model sizes, number of tasks, fine-tuning forms, and large language models, outperforming existing model merging methods. The code is publicly available at: \url{https://github.com/duguodong7/pcb-merging}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。