arXiv:2410.17961cs.LGcs.AI2024-10ICLR被引 25

提出闭式合并方法,让高效模型模块在联邦持续学习中更精准融合。

Closed-form merging of parameter-efficient modules for Federated Continual Learning

  • 通过交替优化逐个求解矩阵,实现可解析的唯一合并结果
  • 在多个联邦分类增量学习场景中达到当前最优性能
  • 适合需要高效模型融合的分布式持续学习任务

模型合并已成为深度学习中的关键技术,可在保持性能与可扩展性的前提下整合多个模型。基于低秩适应(如LoRA)的组合特性,简单平均其模块即可生成一个融合各模块能力的统一模型。本文进一步要求合并后的模型响应与所有原始模块一致,通过闭式求解得到一个包含未知变量A和B的不定系统,表明存在无穷多解。为此,我们提出LoRM,一种交替优化策略,逐个训练一个LoRA矩阵,从而单独求解每个未知变量,获得唯一解。我们将该方法应用于联邦分类增量学习(FCIL),确保客户端间及跨任务的模型响应对齐。实验表明,该方法在多种FCIL场景中表现优异,达到当前最佳水平。代码已开源:github.com/aimagelab/fed-mammoth。

原文摘要 · Abstract (English)

Model merging has emerged as a crucial technique in Deep Learning, enabling the integration of multiple models into a unified system while preserving perfor-mance and scalability. In this respect, the compositional properties of low-rank adaptation techniques (e.g., LoRA) have proven beneficial, as simple averaging LoRA modules yields a single model that mostly integrates the capabilities of all individual modules. Building on LoRA, we take a step further by imposing that the merged model matches the responses of all learned modules. Solving this objective in closed form yields an indeterminate system with A and B as unknown variables, indicating the existence of infinitely many closed-form solutions. To address this challenge, we introduce LoRM, an alternating optimization strategy that trains one LoRA matrix at a time. This allows solving for each unknown variable individually, thus finding a unique solution. We apply our proposed methodology to Federated Class-Incremental Learning (FCIL), ensuring alignment of model responses both between clients and across tasks. Our method demonstrates state-of-the-art performance across a range of FCIL scenarios. The code to reproduce our experiments is available at github.com/aimagelab/fed-mammoth.

联邦学习持续学习模型合并低秩适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。