提出时间模型融合框架,解决逐步加入专家模型的整合难题。
How to Merge Your Multimodal Models Over Time?
- 按时间轴分初始化、部署、融合三阶段统一管理专家模型
- 实验证明从基础模型重启训练比继承合并模型更优
- 适合长期迭代、渐进式学习的多任务系统设计
模型融合将多个在不同任务和领域上微调的专家模型合并为一个更强大的模型。然而,现有方法通常假设所有专家模型同时可用。现实中,新任务和领域随时间逐步出现,需动态整合新知识,这一过程称为时间模型融合。它引入了以往工作未覆盖的独特挑战,例如:训练新任务时,专家模型应从合并的历史专家还是原始基础模型开始?是否应在每个时间步都融合所有模型?哪种融合技术最适合时间融合?不同策略是否适用于训练初始化与部署?为此,我们提出统一框架TIME(时间模型知识整合),涵盖三个维度:(1) 初始化阶段,(2) 部署阶段,(3) 融合技术。基于TIME,我们在FoMo-in-Flux基准上研究了不同模型规模、计算预算和学习周期下的时间模型融合。全面实验揭示了关键洞见,深化了对当前挑战的理解,并提供了有效的最佳实践。
原文摘要 · Abstract (English)
Model merging combines multiple expert models - finetuned from a base foundation model on diverse tasks and domains - into a single, more capable model. However, most existing model merging approaches assume that all experts are available simultaneously. In reality, new tasks and domains emerge progressively over time, requiring strategies to integrate the knowledge of expert models as they become available: a process we call temporal model merging. The temporal dimension introduces unique challenges not addressed in prior work, raising new questions such as: when training for a new task, should the expert model start from the merged past experts or from the original base model? Should we merge all models at each time step? Which merging techniques are best suited for temporal merging? Should different strategies be used to initialize the training and deploy the model? To answer these questions, we propose a unified framework called TIME - Temporal Integration of Model Expertise - which defines temporal model merging across three axes: (1) Initialization Phase, (2) Deployment Phase, and (3) Merging Technique. Using TIME, we study temporal model merging across model sizes, compute budgets, and learning horizons on the FoMo-in-Flux benchmark. Our comprehensive suite of experiments across TIME allows us to uncover key insights for temporal model merging, offering a better understanding of current challenges and best practices for effective temporal model merging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。