arXiv:2501.01850cs.LGcs.AI2025-01被引 30

提出LCFed框架,提升异构数据下的联邦学习效率与精度

LCFed: An Efficient Clustered Federated Learning Framework for Heterogeneous Data

  • 通过模型分块和差异化聚合,实现组内协同训练融合全局知识
  • 在多个数据集上测试准确率优于现有方法,计算开销更低
  • 基于低秩模型设计轻量级相似度度量,支持实时聚类更新

集群联邦学习(CFL)通过将具有相似数据分布的边缘设备分组,缓解联邦学习中因数据异构带来的性能问题,实现针对各组的协同模型训练。然而,现有CFL方法严格限制知识仅在组内共享,缺乏全局知识与组内训练的融合,导致性能不理想。同时,传统聚类方法随设备数量增加带来显著计算开销。本文提出LCFed,一种高效的集群联邦学习框架。通过模型分块并为每个子模型采用不同聚合策略,有效将全局知识融入组内联合训练,实现最优训练性能。此外,LCFed基于低秩模型设计了一种计算高效的模型相似度度量方法,可实现低开销的实时聚类更新。大量实验表明,LCFed在测试准确率和聚类计算效率方面均优于当前先进基准。

原文摘要 · Abstract (English)

Clustered federated learning (CFL) addresses the performance challenges posed by data heterogeneity in federated learning (FL) by organizing edge devices with similar data distributions into clusters, enabling collaborative model training tailored to each group. However, existing CFL approaches strictly limit knowledge sharing to within clusters, lacking the integration of global knowledge with intra-cluster training, which leads to suboptimal performance. Moreover, traditional clustering methods incur significant computational overhead, especially as the number of edge devices increases. In this paper, we propose LCFed, an efficient CFL framework to combat these challenges. By leveraging model partitioning and adopting distinct aggregation strategies for each sub-model, LCFed effectively incorporates global knowledge into intra-cluster co-training, achieving optimal training performance. Additionally, LCFed customizes a computationally efficient model similarity measurement method based on low-rank models, enabling real-time cluster updates with minimal computational overhead. Extensive experiments show that LCFed outperforms state-of-the-art benchmarks in both test accuracy and clustering computational efficiency.

联邦学习聚类异构数据模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。