arXiv:2501.18659cs.LGcs.DC2025-01

通过聚类与结构引导剪枝,实现个性化联邦学习的高效低耗训练。

SAFL: Structure-Aware Personalized Federated Learning via Client-Specific Clustering and SCSI-Guided Model Pruning

  • 按客户端数据相似性分组,结合结构信息指导模型剪枝。
  • 模型尺寸显著缩小,推理准确率提升,通信开销降低。
  • 适合数据异构性强、资源受限的边缘设备场景。

联邦学习(FL)使客户端在不共享本地数据的前提下协同训练模型,保护隐私。传统方法虽能保障隐私,但面临高计算与通信开销。为此,本文提出SAFL(结构感知个性化联邦学习),通过客户端特定聚类与相似客户端结构信息(SCSI)引导的模型剪枝,提升个性化性能。该框架采用两阶段流程:首先基于数据相似性分组,并利用聚合剪枝标准指导剪枝,识别最优子模型;随后客户端训练剪枝后模型并进行服务器端聚合,确保各客户端获得定制化且高效的模型。实验表明,SAFL显著减少模型规模,同时提升推理精度,在数据异构的联邦环境中表现优异。

原文摘要 · Abstract (English)

Federated Learning (FL) enables clients to collaboratively train machine learning models without sharing local data, preserving privacy in diverse environments. While traditional FL approaches preserve privacy, they often struggle with high computational and communication overhead. To address these issues, model pruning is introduced as a strategy to streamline computations. However, existing pruning methods, when applied solely based on local data, often produce sub-models that inadequately reflect clients' specific tasks due to data insufficiency. To overcome these challenges, this paper introduces SAFL (Structure-Aware Federated Learning), a novel framework that enhances personalized federated learning through client-specific clustering and Similar Client Structure Information (SCSI)-guided model pruning. SAFL employs a two-stage process: initially, it groups clients based on data similarities and uses aggregated pruning criteria to guide the pruning process, facilitating the identification of optimal sub-models. Subsequently, clients train these pruned models and engage in server-based aggregation, ensuring tailored and efficient models for each client. This method significantly reduces computational overhead while improving inference accuracy. Extensive experiments demonstrate that SAFL markedly diminishes model size and improves performance, making it highly effective in federated environments characterized by heterogeneous data.

联邦学习模型剪枝个性化异构数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。