解决联邦学习中异构低秩适配的梯度偏差问题,提升模型收敛性与性能。
FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation
- 用全秩全局模型校准聚合,避免参数截断引入的偏差。
- 理论推导最优聚合权重,实现1-3%的性能提升。
- 适合研究联邦学习与大模型微调的科研人员。
联邦学习(FL)使基础模型(FMs)能够利用分布式数据进行微调,其中低秩适配(LoRA)因其通信成本低且性能强而广受欢迎。尽管现有工作已认识到异构LoRA在联邦学习中的优势并提出灵活算法,但我们的理论分析揭示了一个关键缺陷:现有方法缺乏形式化收敛保证,原因在于参数截断和梯度更新偏差。具体而言,客户端自适应不同LoRA秩需截断全局参数,产生固有截断误差,导致后续梯度更新不准确,且误差随训练轮次累积,最终影响性能。为此,我们提出FedHL——一种专为异构LoRA设计的简单高效联邦学习框架。通过以全秩全局模型作为校准聚合基底,消除初始对齐时由客户端秩差异带来的截断偏差。此外,我们通过最小化收敛上界中的梯度漂移项,推导出理论上最优的聚合权重。分析表明,FedHL可保证$/mathcal{O}(1/ ext{sqrt}{T})$的收敛速率。多个真实数据集上的实验显示,其性能较多种先进方法提升1-3%。
原文摘要 · Abstract (English)
Federated Learning (FL) facilitates the fine-tuning of Foundation Models (FMs) using distributed data sources, with Low-Rank Adaptation (LoRA) gaining popularity due to its low communication costs and strong performance. While recent work acknowledges the benefits of heterogeneous LoRA in FL and introduces flexible algorithms to support its implementation, our theoretical analysis reveals a critical gap: existing methods lack formal convergence guarantees due to parameter truncation and biased gradient updates. Specifically, adapting client-specific LoRA ranks necessitates truncating global parameters, which introduces inherent truncation errors and leads to subsequent inaccurate gradient updates that accumulate over training rounds, ultimately degrading performance. To address the above issues, we propose \textbf{FedHL}, a simple yet effective \textbf{Fed}erated Learning framework tailored for \textbf{H}eterogeneous \textbf{L}oRA. By leveraging the full-rank global model as a calibrated aggregation basis, FedHL eliminates the direct truncation bias from initial alignment with client-specific ranks. Furthermore, we derive the theoretically optimal aggregation weights by minimizing the gradient drift term in the convergence upper bound. Our analysis shows that FedHL guarantees $\mathcal{O}(1/\sqrt{T})$ convergence rate, and experiments on multiple real-world datasets demonstrate a 1-3\% improvement over several state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。