用少量无标签数据评估模型合并兼容性,提升合并效果。
M-Loss: Quantifying Model Merging Compatibility with Limited Unlabeled Data
- 提出M-Loss指标,通过对比参数平均与模型集成的差异评估合并兼容性。
- 在有限无标签数据下,显著提升合并模型与集成效果的对齐度。
- 适合需要高效合并多个大模型的研究者和工程团队。
大规模模型训练计算成本高且常受限于标注数据。模型合并无需额外数据或训练,可直接整合多个源模型的权重。然而,传统方法如参数平均易混合非泛化特征,尤其当源模型权重差异大时。相比之下,模型集成通过输出平均提供更稳定性能,但带来更高的推理开销和存储成本。尽管已有实验表明合并与集成存在相似性,但缺乏理论依据和评估指标。为此,我们提出合并-集成损失(M-Loss),一种基于极少量无标签数据的评估指标,用于量化源模型合并的兼容性。M-Loss在层和节点层面测量参数平均与模型集成之间的差异,指导更有效的合并策略。理论分析与实证结果表明,将M-Loss融入合并过程可显著提升合并模型与集成结果的一致性,构建出可扩展、高效的模型融合框架。
原文摘要 · Abstract (English)
Training of large-scale models is both computationally intensive and often constrained by the availability of labeled data. Model merging offers a compelling alternative by directly integrating the weights of multiple source models without requiring additional data or extensive training. However, conventional model merging techniques, such as parameter averaging, often suffer from the unintended combination of non-generalizable features, especially when source models exhibit significant weight disparities. Comparatively, model ensembling generally provides more stable and superior performance that aggregates multiple models by averaging outputs. However, it incurs higher inference costs and increased storage requirements. While previous studies experimentally showed the similarities between model merging and ensembling, theoretical evidence and evaluation metrics remain lacking. To address this gap, we introduce Merging-ensembling loss (M-Loss), a novel evaluation metric that quantifies the compatibility of merging source models using very limited unlabeled data. By measuring the discrepancy between parameter averaging and model ensembling at layer and node levels, M-Loss facilitates more effective merging strategies. Specifically, M-Loss serves both as a quantitative criterion of the theoretical feasibility of model merging, and a guide for parameter significance in model pruning. Our theoretical analysis and empirical evaluations demonstrate that incorporating M-Loss into the merging process significantly improves the alignment between merged models and model ensembling, providing a scalable and efficient framework for accurate model consolidation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。