将多个大模型参数合并成一个,无需重新训练即可组合专用能力。
Model Merging in the Era of Large Language Models: Methods, Applications, and Future Directions
- 通过权重平均、任务向量运算等方法融合多模型参数
- 支持多任务学习与领域专精,节省训练成本
- 适合需要快速集成多种能力的开发者和研究者
模型合并将在微调后的大语言模型(LLMs)日益增多的背景下,将多个神经网络的参数整合为单一模型,无需额外训练。该方法为集成模型和全量重训提供了计算高效的替代方案,使从业者能以极低成本组合特定功能。本文基于FUSE分类体系,从基础理论、统一策略、应用场景和生态支持四个维度系统梳理模型合并技术。首先建立合并的理论基础,包括损失曲面几何与模式连通性;接着系统回顾权重平均、任务向量算术、稀疏化增强方法、专家混合架构及进化优化等算法;进一步分析其在多任务学习、安全对齐、领域专精与联邦学习中的应用;并调研工具链与评估基准。最后,指出关键挑战与未来方向,旨在为研究者与实践者提供结构化推进路径。
原文摘要 · Abstract (English)
Model merging combines the parameters of multiple neural networks into a single model without additional training. As fine-tuned large language models (LLMs) proliferate, merging offers a computationally efficient alternative to ensembles and full retraining, enabling practitioners to compose specialized capabilities at minimal cost. This survey examines model merging in the LLM era through the \textbf{FUSE} taxonomy, organized along \textbf{F}oundations, \textbf{U}nification Strategies, \textbf{S}cenarios, and \textbf{E}cosystem. We first establish the theoretical underpinnings of merging, including loss landscape geometry and mode connectivity, then systematically review the algorithmic space spanning weight averaging, task vector arithmetic, sparsification-enhanced methods, mixture-of-experts architectures, and evolutionary optimization. We further examine downstream applications across multi-task learning, safety alignment, domain specialization, and federated learning, and survey the supporting ecosystem of tools and evaluation benchmarks. Finally, we identify key open challenges and future directions, aiming to equip researchers and practitioners with a structured foundation for advancing model merging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。